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(57) Abstract 

An object monitoring system includes a camera node (2) for monitoring movement of an object (18) to determine an acqui- 
sition lime when an .mage of the object (18) is to be acquired and acquiriog the image at tbe predetermined time. The system in- 

^ I*?" 16 ! 3 (6) WhlCh lS 3b,C 10 mOnit0r ra0Ving objects (18) ' and image Processing circuitry (10), responsive to the camera 
ifih wnich is able to detect a predetermined moving object (18) from other moving and static objects. From the image acquired 
information identifying the object (18) can be automatically extracted. The system is particularly suited to monitoring and discri-' 
rninatmg arge vehicles (18) from other vehicles over a mutti-bne roadway, and acquiring high resolution images of the large v e . 
hides (18) at a predetermined acquisition point (22). Image data acquired by a plurality of camera nodes (2) can be sent over a 
digital telecommunications network (45) to a central image processing system (42) which can extract vehicle identifying data such 
as licence plate details, and obtain information on vehicle travel between nodes (2). 
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AN OBJECT MONITORING SYSTEM 

The present invention relates to an object monitoring system and, in particular, to 
a system for monitoring vehicles. 



Authorities responsible for traffic management and the laws which govern the use 
of vehicles require systems which can monitor traffic continuously and detect breaches 

10 of the law, without requiring the expense of having personnel present at the scene of the 
infringement. Systems which are able to monitor a large number of locations, detecr 
infringements and issue infringement notices are particularly advantageous as they relieve 
personnel, such as police, from the task of traffic management and allow ifaem to pursue 
other tasks. By continuously monitoring a location the systems also act as a deterrent to 

15 infringers and may assist in reducing accidents which cause road fatalities and casualties. 
It would also be advantageous to be able to monitor road usage in order to make 
decisions on road damage caused by heavy vehicles. 

A number of traffic management systems are presently in use, such as speed 
20 cameras and red light cameras for road traffic. The known systems employ cameras 
which arc triggered when an infringement is detected. Optical sensors placed on the side 
of the road, pressure sensors placed underneath the road and radar signals reflected from 
vehicles arc used to detect the presence of a vehicle and determine infringement. The 
sensors and radar signals are used to generate a trigger signal to activate a camera to take 
25 a picture of vehicle which includes details from which the vehicle can be identified, such 
as a car licence plate. Use of road based sensors is disadvantageous as they require the 
road to be altered or excavated for installation or, when placed on the side of the road, 
can be easily detected and damaged. Also electrical cabling needs to be installed and 
connected between the sensors and the camera. The use of electromagnetic signals which 
30 are transmitted to and reflected from a vehicle, such as radar signals, to detect presence 
and infringement is also disadvantageous as these signals can be detected by detection 
units placed in a vehicle to alert the driver as to their presence. 
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md infringement Whoa, m "agnctic <— « "*» — 



sensors. 



, Tuc cameras prt in use use fita "* *" 

as,,™ ~ — * " *■ loca,io,l °! ,he Tr 

Accordingly. , — - - 1* — ^ "° ^ ^ 

film and do not continuously monitor u» ".responding utfersectton. 

Speed detection sys«nK wh.cn - only cameras are descried in a number of 

prions. *^-*-^^^-^* , *r" , C 

Lringements but the systems are re,a.ive,y ItaM « aspect to the «*— ** 
^ JLin on a vehide whilst it is ben* monitored, and the systems are *. unable . 
selecrivdy acquire uubrmation on specified vchide types. 

by personnel to extract .be information . identify <h= vehicle and de.crra.ne .he person 
responsible lor i, which is a rune consuming process. If .be image cou.d he proceed 
„iL a redely short tune o f acquisition then i. could be used as a bas* for alerting 

20 aumorities in d. region - -* - « * * —* * ^ J*™ 1 

identifies i. as taingsmlen. According.,. * would be advamageous - prov.de a sysren, 
whfch can process images in real tune to obtain detailed information on a veh.de and 
^ alert uunrruanon and infrmgeme* notices without requinng human in.ervent.on. 

« When traveUing a long disrance, vehicle user's, in particular tn.de drivers .end . 

Jeds the limit, the known systems for deleting speed infringernen. concentre o„ 
decamg *. u«an,aneous speed of » vehide a. a particular location and therefore 
30 depending on .he location at which the detecnon unit is placed, it ma, no. detect usefs 
2 infringe sporadical., over a long distance. Also trudt and bus drive, who exceed 



may not be detected. Hence, it would be advantageous to provide a system which can 
detect the average speed of a vehicle over a relatively long distance. Ir is also 
advantageous to provide a system which can monitor vehicles in more than one lane of 
a multi-lane carriageway. 

The present invention provides an object monitoring system comprising camera 
means for monitoring movement of an object to determine an acquisition time when an 
image of said object is to be acquired and acquiring said image at said predetermined 
time. 

The present invention also provides an object monitoring system comprising 
camera means for monitoring moving objects, and image processing means, responsive 
to said camera means, for detecting a predetermined moving object from other moving 
and static objects. 

The present invention further provides an object monitoring system comprising 
camera means for tracking and acquiring an image of a moving object from which 
information identifying said object can be automatically extracted. 

Preferably said system includes means for transmitting said image over a digital 
telecommunications network. 

The present invention also provides a vehicle monitoring system, comprising 
camera means for continuously detecting and tracking moving vehicles over a multi-lane 
carriageway, and acquiring images of predetermined vehicles at an acquisition area on 
said carriageway from which identifying information on said vehicles can be extracted. 

The present invention further provides a vehicle monitoring system comprising a 
plurality of camera means for tracking and acquiring images of predetermined moving 
vehicles for a respective area, and means for processing the image data obtained from 
said areas to identify said vehicles and obtain information on the travel of said vehicles 
between said areas. 
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The present invention also provide, a vehicle tnonuoring system compnsmg 

^ means for «*. *— - a— « - «• °" 

type * — — — — ** ^ " Vrt ' deS ° f ' 

said predetermined type. 

invention teber provides a vehicle monitoring system comprising 
^era means for monitoring a vehicle . detect a Uw infringement and de.erm.ne a 

^rmined time to ac^e - - - — - * « " ^ °* 

Ld vehicle a, said prede.era.iaed time in response .0 deling said .nfcngemen, 

■O. present invention also prides a vehide monitoring system comprising 
^ mean, tor monitoring vehicles on a roadway. disoiminaHng betwe« Urge 
chides, such as trndts and .uses, an, sma.1 vehic.es. as ears. - - road^ - 
* . acquire images of only the large vehicles from which veh.de tnfonnattou can be 

15 obtained. 

referred ernWimen. of rhepresen. inveodon is berdnafter described, byway 
of example only, with reference to the accomranytag drawings wherem: 

Figmes Uo 3 arc side views iUusrrating use of a preferred system for momtormg 

M figure 4 * a front perspective v.ew illus.rating - of a preferred svs,em for 

, 5 ^Figure 6 is a b.«* diagram of comK-on across a digital telecoromumcatioas 

Figra e 7 is a v,ew iUusrraring connection of a large number of nodes of the 

vehicle monitoring system; 

Fil o*e 8 is a block tuagram of vehicle detection and image capture oxemtry of 

30 the vehicle monitoring system; 

Figure 9 is a digitised image produced * vehide detection crrcuttry from an 

image generated by a detection camera of the system; 



Figure 10 is a block diagram of the control of the circuit boards of the vehicle 
detection circuitry to perform a segmentation process; 

Figure 11 is a static background image stored in the vehicle detection circuitry; 

Figure 12 is a difference image generated by the vehicle detection circuitry; 

Figure 13 is an image illustrating regions of shadow which are filtered from the 
image obtained by the detection camera; 

Figure 14 is a segmented image derived by the vehicle detection circuitry; 

Figure 15 is a histogram of pixel grey levels; 

Figure 16 is a real time status display generated by the system; 

Figure 17 is a flow diagram illustrating flow between the software tasks of the 
system;. 

Figure 18 is a diagram of the formation of "black triangles 1 ' in a processing 
window of the system; 

Figure 19 is a diagram illustrating measurement of coverage of blob regions 
produced by the system; 

Figure 20 is a diagram illustrating vertical extension of biob regions to perform 
clusters; 

Figure 21 is a graph of extension amounts which are stored in a look-up table of 
the system; 

Figure 22 is a diagram illustrating extension based on blob region width; 
Figure 23 is a diagram of overlap detection for clusters produced by the system; 
Figure 24 is a diagram illustrating a labelling method performed by the system; 
Figure 25 is a diagram of the roadway coordinates used by the system; 
Figure 26 is a graph of the trajectory of clusters; 

Figure 27 is a graph of the trajectory of clusters transformed to the roadway 
coordinates; 

Figure 28 is a diagram of data values obtained by trajectory software of the 

system; 

Figure 29 is a block diagram of a timing control board of the system; 
Figure 30 is a graph of the operating characteristics of the acquisition camera and 
infrared flash of the vehicle monitoring system; 

Figures 31 and 32 are images acquired by the system; 
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Figure 33 is , block diagram of compos of to acquisition camera, - 
toerface compos* ta ftc camera of .he image capture <Mli 

Figure 34 is a Hoc, d,agram of commas component of nodes of .be . 
sysl er., Z .he «»«« of an acouisinon image processus system of .he S ,s,em _ 
5 connect over .he digital .decommunicartoos network; 

Figure 35 is a diagram of .be memory layou. for a buffer board of .be vmage 

processing system and commurueations modules of the nodes; 
10 F ^re37i 5 ablo dc d i .gramofa li ce TO p.a«r ra go» MS y^of.beveh J c l e 

a fiow <*- of ,e ~ modules of .be licence P>a.e 

15 iecogoi :;:T; . - — - . — — - - — ^ 

recognition system; and 

Figure 41 is a Cow diagram of a, optical charter recoguinon module of the 

licence plate recognition system. 

20 Ave ^e monitor^ sysKm. as shown u. Figures l.o7, induces a camera node 

^ ^ch is mounred on a bridge or pylon 4 above veh.de traffic as shown in Frgures 1 

to3 . Tte «^^2^.^"^*-^ k -^* 

c^a S and a node control unit 10. Both cameras 6 and 8 are monochrome CCD 

resolution, and the image acquisition camera being a high resolution camera. 

The detection camera 6 has a -vide field of view 12 of pax. of a vehicle 
^.gewa, 16 which is to be monitored b, .he node Z. Tne diction camera 6 
30 monil v^es in .he field of view » and ,he control unit 10 process « 
^ired by to detection camera 10 .o detect and drscrimtnae vdndes from otor 
Z~ in to fie.d of v,ew 12. As a vehicle IS en.ers .he fidd of view u and raoves 



-1- 

towards the node 2, the node 2 analyses the images produced by the detection camera 6 
to first detect the vehicle 18 as being a moving object, which is different from other 
moving objects or the still background in the view 12, and determines whether the vehicle 
18 constitutes an object for which a high resolution image thereof should be obtained by 
5 the image acquisition camera 8. The image acquisition camera 8 is mounted on the 
bridge or pylon 4 so as to have a limited field of view 20 which will include the front 
of a vehicle 18 when it reaches a predetermined location 22 on a carriageway 16. The 
location 22 and the field of view 20 are chosen to be near the point where moving 
vehicles will leave the field of view 12 of the detection camera 6, as shown in Figure 3. 

10 On determining that the vehicle 18 represents an object for which an image is to be 
acquired, the node 2 estimates the time when the vehicle 8 will enter the field of view 
20 of the acquisition camera 8, on the basis of the movement of the vehicle which has 
been monitored by the detection camera 6. The node 2 provides trigger information to 
control circuitry associated with the acquisition camera 8 so as to trigger the camera 8 

15 at the estimated time. A high resolution image of the front of the vehicle 18 is obtained 
from which considerable identifying information can be derived, such as vehicle type and 
licence plate details, by subsequent digital electronic processing of the image. 

In addition to identifying the vehicle 18 and estimating the time for triggering the 
20 acquisition camera 8 the node 2 is able to use the images from the detection camera 6 
to discriminate between vehicles on a number of characteristics, such as size, to 
determine those for which high resolution images are to be acquired. For example, the 
system is able to distinguish between large vehicles such as trucks and coaches, and other 
moving objects within the field of view 12, such as cars and motor bicycles. The node 
25 2 is also able to determine from the images obtained by the detection camera 6 the 
current speed of the vehicle 18 and whether the driver is com mining any traffic or other 
offences, such as taiigating or illegal lane changing. The system can also be used to 
detect stolen vehicles. 

30 The detection camera 6 and the control unit 10 are able to monitor all of the 

moving vehicles 18 and 22 within the field of view 12 whilst acquiring the images of 
selected vehicles at the location 22. For a multi-lane carriageway 21, as shown in Figure 
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4 rhe field of view 12 of the detection camera 6 extends over aU of the lanes 23 and J 
„ ,be carriageway and an image acquisition cam-. 8 is provided for each U- 
25 The node 2 is therefore able to monitor the moving vehicle IS .0 detemune „ whtch . 
laIK « will be when it reaches the image capote location 22 and activate* as reeled, 
the acquisition camera 8 corresponding to that lane 23 or 23 

T* control unit 10. as shown in figure 5. includes vehicle detection circuitry 30 
for processing the images generated by .he detection camera 6 so as to provide tagger 

• ,.*TT,*r a ft A selected camera 8 is triggered 
signals on a bus 32 to the image acqu.svt.on camera 8. Aselec 

, t0 acquire ao image in accordance with the timing information determined by U>. 
de^tion cuxurrry 30. and the camera 8 provdes a trigger signal on a line 36 » a ffcsh 
feting M 38, of a corresponding infrared flash 40 mounted adjacent the seleefcd 
acqnisirioncameraS, The image chained b, the trigger action camera 8 * ««* 
by an image acquisition circuit 3*. The detection circuit 30 determn.es the tight *_? 
5 withintefieldof vicwUof the det«»on camera 6 so as to determine 4e correct level 
of exposure for the acquisition camera 8, and in mm the correct level of energy to he 
discharged by the flash 40 to achieve the desrred ievel of exposure. The use « an K 
flasb is advantageous as activation ,s difficulr to detect visually Visible wavelengths 
produced by the flash are removed by tR band pass filters. 

20 

Tte vehicle monitoring syaem mcludes an acquisition image processus system 
42 connected to the control unit 10 for recetvng and processing the images acqtured by 
*. camera 8 to extract vehicle information therefrom. The acquisition image processmg 
^srem 42 may form pax, of the ntxfc 2 « be positioned remote from the node and 
25 connected to the control unit by a telecotnmunicahons line 44 from the acquisition en. 
34 The system 42 comprises a process-* station 43 configuKd to automatical extract 
the required information from the image, such as licence plate detatU SO. 

Tne acquisition image pressing system 42 when implemented at a rem«e central 

30 site *^*r^6.M^°>™^™^°^ SS <°° mC ^' 0iP '* K 
dirital telecommunications rework 45, and a centra! computer server 47 wbrch serves 
alocalarea .etworic (US) connecting compute* which implement an acquisition rmage 
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database 49, a licence plate recognition system 51 and a remote site user interface 53. 
The communications controllers 55 are provided for each node 2 which sends images to 
the processing system 42. The nodes 2 each include an image buffer and 
communications controller 57 for storing images obtained by the acquisition circuit and 
5 communicating with the communications controllers 55 of the central image processing 
system 42 to send the images over the integrated services digital network (ISDN) 45 to 
the central server 47, The communications controllers 55 manage the high speed image 
transfers over the ISDN 45, and handle housekeeping, error detection and correction for 
image transfers berween the nodes 2 and the central server 47- The central server 47 
10 communicates with the controllers 55 so the nodes 2 act as extensions of the LAN 
maintained by the server 47. Image processing can also be performed at each of the 
nodes 2, for example, the nodes 2 may each include a licence plate recognition system 
51 which performs optical character recognition (OCR) on the acquired images to extract 
vehicle information, such as licence plate details. 

15 

The vehicle monitoring system, as shown in Figure 7, comprises a plurality of 
camera nodes 2 mounted at a number of locations 52 to 60 on vehicle carriageways. The 
nodes 2 may be connected by telecommunications lines of the ISDN 45 to communicate 
with another and/or connected to a central control station 62, so as to compare 

20 information collected at each of the nodes 2. The control station 62 includes the 
acquisition image processing system 42. The nodes 2 and the control station 62 are able 
to monitor a vehicle s progress along the carriageways 16, 64 using information collected 
by the nodes 2, which includes, in addition to vehicle identifying information, the date, 
time and location at which an image is acquired. This is particularly advantageous as the 

25 information can be used to determine the average speed at which a vehicle has travelled 
between two nodes 2. If the average speed indicates that the vehicle has exceeded the 
speed limit in travelling berween the nodes, then authorities can be contacted so as to 
intercept the vehicle. Alternatively, the central station 62 issues an infringement notice 
to the registered owner of the vehicle. The station 62 and/or the nodes 2 may also 

30 contain information on stolen vehicles and the authorities are contacted when a stolen 
vehicle is detected. Vehicle driveis negotiating long distances would be reluctant to 
instantaneously exceed the speed limit at chosen locations, if they are aware that they will 
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* in.erccp.ed or issued with - infringe* nonce by ,ravellin g « — 

JUondiag ,o a pa— «* ^ * -*» » — « aV 7^ 5 ^ 

daecnon of drives who tail to Bto scheduled rest stops. 

* detect camera 6 produces video fields of 312 and 313 horizon* scan lirKS 
10 respective!, which are each d«plica,ed to produce a comply 625 line vide, frame. The 

1 ZL are L— * — — *~ ^ 7, " 

. video 6 eld period of 20 ms. * vertical region of the de^on camera 6 . 
Lpendcr, on .he «*- « .ine region which is app,— 300 element 
ised into 512 ^ for a maximum dis^ce which the camera 6 can vrew on a 
1S horizontal roadway. The maximum distonce D is given by: 

D - htan [arctanCP^Jh) * *] 

^ D = distant along road covered by camera view 
h = height of camera above road 

D = distance of closest position of camera view along roadway 

'•'alia 

4> = lens field of view angle 



20 



The field of view across the roadway is given by: 

(2) 



25 



where W = field of view across the roadway 
w - width of the sensor 
f = lens focal length 
L = object distance from camera 



The camera 



6 includes a 12 mm lens and an 8.8 mm i 6.6 mm CCD sensor to 



optimise vehicle image size and maintain a four lane coverage, 3.5 metres per lane, at the 
image acquisition points 22. An antiblooming and antismear sensor is included to prevent 
blooming or smearing of an image by vehicle lights. The infrared filter of the camera 
permits a infrared wavelengths up to 950 am, which allows rhe detection camera 6 to 
5 receive the infrared component of vehicle lights, thereby providing more image 
information to detect and monitor vehicles. The detection camera 6 has a +40 dB gain 
range, and the exposure time is fixed at the field period, 20 ras. 



The exposure control of the detection camera 6 controls the intensity of light 
10 falling on the camera sensor so as to maintain consistent video signal quality and obtain 
a predictable representation of a vehicle. Acceptable exposure of the sensor can be 
maintained through the appropriate match of sensor sensitivity and control of the intensity 
or power of the electromagnetic wavelength failing on the sensor, as shown with 
reference to equation 3. 

E«(HA)T (3) 

15 where E = exposure of light on sensor 

H = incident e.m.r. power per cm 2 (iiradiance) 
A = area of pixel site in cm 2 

T = time in seconds that light or e.m.r falls on sensor 



20 The time T light falls on the trigger camera is held constant at the video field rate 

of 20 ms. This is sufficiently short to "freeze" the motion of the vehicle in the relatively 
large field of view 12 of a multi-lane carriageway. A shutter is not included in the 
detection camera 6 as electronic shutters or short duration exposure control produced 
adverse effects from either image smear or blooming from sunlight reflections or vehicle 

25 headlights, as exposure times were shortened. The incident light iiradiance, H, required 
to provide sufficient exposure of a sensor pixel is dependent on the sensitivity to a 
particular wavelength of light. Sensor pixels also have a minimum light sensitivity to 
produce a satisfactory signal to noise ratio in the video signal, and a maximum light level 
before the sensor pixels become saturated. The range of light iiradiance rhat can be 

30 imaged in a single exposure for the sensor is approximately 100:1. The range of light 
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^dianee which can be ^ » «1« — « **» » » - ^ 

by as much =3 Ufcl. Accordingly, rhe «^re control system «■* H -OMIT <° 
^ tt within the dynamic « of the sensor to prevent sensor saturation from the 
HA levels typical., present during a 24 hour penod. The exposure control . a 
5 fl 8 ,o f 1000 auto to lens system whicb is designed to provide exposure adjustment 
based on tens aperture and progressive neurra. density filtering of lign. - <°< 
apenure decreases. Toe rate of change of the exposure control, or .he rate that H 
changes, is repriced as moving vehicles are located by differencing images obtamed by 
,he camera 6 from a slowly changing background hnage, as described hereinafter. The 
10 r*e of change is restricted to ensure changes in exposure of the sensor are not mrstaken 
te changes in the background unagc. which weld adversely affect detection and 
monitoring of vehicles. Toe auto iris reaction rune is set to match the ratio * vrtuch 
background images are subtracted from the current image. The siow rate of change also 
prevents the iris responding too fast to transient changes in light, for example, reflected 
15 offroofsofvehidesasrheypassclosetorhecameraS. The rate of change is resmcted 
,o 10 seconds for a halving or doubling of light tadiance H. 

The exposure control system ensures that transien. extremely bright reflections or 
headlights do not saturate the sensor pi»U b, limiting the exposure on the sensor to keep 
ffl 1, below the sensor's saturation level fo, the peak intensity of Ugh. received in the field 
of view 12 The peak video level otaained from me camera 6 is monitored, as dtscussed 
hereinafter, and used as a basts for controlling ft. setting of the diaphragm of .he ms. 

The sensor sensitivity is selected in order to produce video signals which allow 

iUnminationlevels. The sensor is also responsive to near infra-red Ugh, to maxrrnisethe 
signal from large vehicle side and perimeter lights, vet the response must be sttU below 
a threshold where blooming may occur from vehicle headlights. The lens of the camera 
6 can be controlled fuUy to provide sufficient exposure for the sensor for vehicles without 
30 headlights during the dawn and dusk periods. The maximum lens aperture is held ,. ft 
for . luminance value of about 10 cd/m' reBccung from the carriageway. Once the 
caoiagewa, luminance level fall below approxima^ly 25* of this level, vehicle 
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segmentation, as discussed hereinafter, is based on vehicle headlights. Control signals 
representative of the illumination levels are derived from an illumination histogram of 
video signal levels for the pixels, described hereinafter. 

5 The control unit 10 of a camera node 2, as shown in Figure 8, includes a 

Motorola 68030 CPU 64 and a detection and trigger sub-system 66 connected to receive 
images from the detection camera 6, and an acquisition sub-system 68 connected to 
receive images from the acquisition camera 8. The sub-systems 66 and 68 include a 
number of Datacube pipelined pixel rate video processing circuit boards which are 

10 controlled by the CPU 64. The boards and the CPU 64 are mounted on and interlinked 
by a VME (Versa Module Europe) bus. The CPU 64 and the boards of the sub-systems 
66 and 68 run a software operating system known as VxWorks, which is a real time 
multi-tasking system. The detection sub-system 66, the CPU 64 and controlling 
software form the detection circuit 30, and the acquisition sub-system 68, the CPU 64 

15 and the controlling software form the acquisition circuit 34. The image buffer and 
communications controller 57 can be connected to the acquisition circuit to provide 
access to the ISDN 45. 

The detection sub-system 66 processes the 512 x 512 pixel images of each video 
20 field obtained by the detection camera 6 and is designed to achieve low latency between 
changes in the field of view 12, by using pipelined processing of the image data with no 
intermediate storage. The data rate through the video data paths of the pipeline, known 
as MAXBUS, is 10 million pixels per second. Processing the video fields individually, 
as two consecutive frames of half vertical resolution, achieves a sample rate of 50 Hz and 
25 eliminates the deinterlacing latency required for full frame processing. 

The detection sub-system 66 includes a video digitiser board 74 which receives 
the fields output via the detection camera 6 and converts them into the 512 x 512 pixel 
representation. The digitiser board 74 is a Datacube Digimax board and produces a 
30 greyscale image representation with each pixel having a value within the 2's complement 
positive range of 0 to 127, 0 representing black and 127 representing white. The 
512 x 512 pixels are able to produce a live image display as shown in Figure 9. The 
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taa ge placed by the digiriser board 74 is input to a background difference board 76 
which as shown in Figure 10, subtracts a background image, as shown vu Figure 11, from 
the current or live image .0 produce a preliminary ditterer.ee image, show, in Frgure 12. 
The difference rmage comprises a grey level of representation of .he moving objects 
5 within .he field of view 12 By virtue of the image subtraction the pixel image range for 
the difference image enends from -128 to 127. The background dtfferencer board 76 
is a Datacubc MaxSP board. 

The background image represents the static background viewed by the detection 
U camera 6 and is stored in one of two frames*^ 71 of a background image store board 
70 being a Dastcnbe Framestore board. Tie background image is continually updated 
by'a background updae board 72, which is ancrfber Datacube MaxSP board that ensures 
one of tbeframestores 71 holds an image correctly representative of ore static background 
within the fieUl of view 12 of the deletion camera 6. The update board 72 then receives 
!5 the current background image from one of .he frames*™* 71b and is combtned wt,h a 
Stored form of the r^iminary difference image «. produce a new background rmage 
which is ourputted by the update board 72 ,0 the other fnn.esK.re 71a. Tne coutrolltng 
software then switches to tie other framestore 71a for submission of the background 
image to the difference, board 76, and ensures .he next updated image is submitted to the 
20 first framestore 71b. Tne background update board filters the preliminary difference 
image in accordance with a filter characteristic 73, as shown in Figure 10, which rs held 
in RAM and performs a limiting function on the grey level pixels of the prelrmnrary 
difference image so as to restrict rnem between a programmable range, for example -2 
and *2 pixel range. The limiting function restricts the correction made ,0 the current 
25 background image when it is combined with the difference image, after havmg been 
subject to a delay 74 to allow for the time taken to apply the limiting filter function 73. 
He limiting function ensures the correction made to the background image per frame vs 
only slight so that transient differences, such as arose produced by moving objects, are 
nor allowed to significantly alter the stored background image held in the image «ore 
30 board 70. The shape of ate fiUer function 73 represents that grey level differences added 
to the background image are confined to a level . for all difference levels >. and - for 
,U difference levcfc <-t, wbe* . is a low threshold such as 2. The state of the 
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background update board 72 can also be changed to disable update of the background 
image. The rate of change in the background image is set so as to be faster than the rate 
of change of scenic exposure due to variation in the lens aperture of the detection camera 
6. The rate change governed by the limiting function is important because if the rate is 
5 too slow lighting changes can produce incorrect difference images, and if the rate is too 
fast then moving objects may appear in the background image as a blur. 

The preliminary difference image produced by the background differencer board 
76 is outputted to a third Datacube MaxSP board, a shadow elimination board 77. The 

10 shadows produced by vehicles which appear in the difference image, shown in Figure 12, 
pose a significant problem for the images processed to determined the type of vehicle. 
The shadows can mistakenly represent the vehicle as being larger than its actual size, and 
if a discrimination is being made between the large vehicles, such as trucks and buses, 
and small vehicles, such as cars and motorcycles, then the shadow cast by a car can lead 

15 to it being classified as a large vehicle. Therefore the shadow elimination board 77 is 
employed to eliminate all grey levels in the difference image which could represent 
shadows. This is done by defining a grey level window range 79 in RAM, as shown in 
Figure 10. whereby the preliminary difference image is processed so as to set to zero all 
pixels having a grey level within the window 79. The result is then used to mask the 

20 preliminary difference image so that the elimination board 77 outputs a shadow filtered 
difference image having all of the pixels with grey levels within the window range 79 
removed. Figure 13 illustrates a live image with all of the pixels having a grey level 
within the range of the window 79 shown as green. The range defined by the window 
79 is adjusted depending on the light conditions within the field of view 12 of the 

25 detection camera 6, as discussed hereinafter. 

The shadow filtered difference image is inputted to a threshold and median filter 
board 78, which is a Datacube Snap board. The filter board 78 performs binary image 
processing on the difference image so as to convert the grey level representation of the 
30 moving objects to a binary representation, which corresponds to white or black, for 
further processing by the detection sub-system 66. The filter board 78 uses a threshold 
value to convert all of the pixels, with grey level values within the range -128 to +127, 
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t0 piX c,s having vaiues of either 0 o, 255. Accordingly. * «- **« 
I d * the fiUer boari 78, when viewed by a realtime «^r. shows the moving 
produced b * « of ^ pixel blob5 , as iuusaated in 

objects wi.hu. the Seld of v,cw 12 
Figure 14. The blobs ma, correspond to pam of movmg 

- 2 » night, n»V correspond - '** " ' VeUC,C ' S ^ T 

bin*, median filtering ou 3 by 3 pixel neighbours. 

Ugh. conditions wUhiu the field of view 12 o, .he detection camera 6 are 

A Th reference . a histogram 150, as shown in Figure 15. of pixel gre, leveis 
10 determined with reference want P bad tgro«nd 
-i CPU 64 Tbe CPU 64 processes a window of the storeo □ s> 

produced by the CPU 64. seconds. The CPU 64 

image which is approximately 300 x 400 pixels vi 

JLs the number of pixels in the window having each „ .eve and ubu.*« «* 
"1 as the histogram 150, with the number of pixels on .be vemca, ax* 1SZ - 
15 ^ val- on .he hoiizomal axis 154. The histogram 150 can be displayed .o 

Z-tL which represent the position of the median 156. one of .hree 
Hons, day. dus, or mgh, can * — *— ~ ^ 
„ b. the same lighting condition as dusk. The postbons of the peak 155 med * 1 
20 Id die minimum 158 are used to determine the range of the window „ used m the 

• hn^rf 77 For daytime conditions, the shadow wmdow 79 rs 

shadow elimination board 7 /. roi ™ 

Inned as be*g from the vah.es .peak to ♦ ^ ~ • ■ W-J 
0 5 For dusk conditions, the shadow window 79 is from minimum .o (peak + median)* 
£££ of course, do no, need » be eUminaied during nigh, coupon. 

; permanent shadow are in the fie,d of v,w 12, such as cas. by trees or an overpass 

bridge. 

^ rented unnes produced by the filter board 78 are submitted . an Are, 

30 ^^<»^^^~^ Sn ^^\7t 
Microsy^ems, of AdeUide Australia, designed to acce.erate .he processing of area 

^Z« 0 objects inavideoscenc. ne .ard 80 opera.es wim con^Uing software 



to perform analysis of the white pixel blobs within a 300 x 400 pixel window 
corresponding to the window on which the histogram 150 is produced. The APA board 
80 and the software perform a classification and feature extraction process in real time 
on the blobs so as to facilitate the formation of clusters of blobs which correspond to a 
moving vehicle. The APA board 80 computes features of the white pixel blobs and the 
features are used by the clustering software to determine, on the basis of rules and 
classification code, whether the blobs can be combined to form a cluster. Once formed, 
the size of a cluster indicates whether it corresponds to a large vehicle, such as a truck 
or bus, or a small vehicle, such as a car. Labelling software js used to monitor 
movement of clusters over successive fields so as to determine which clusters arc to be 
assigned a unique label and which clusters are to share a label, as they are considered to 
relate to the same vehicle, 

Different considerations apply in respect to whether the carriageway 16 is being 
viewed by the detection camera 6 at night or during the day, and the rules and 
classifications used are adjusted, on the basis of the data provided by the histogram 150. 
to account for night conditions, rain and inclement weather, which result in a moving 
vehicle producing different corresponding pixel blobs. For example, the rules and 
classification code needs to be adjusted to account for reflection produced by vehicle 
lights on the road during night conditions. 

Once a cluster has been formed, its movement is monitored to determine its 
instantaneous speed and its position with respect to a point on the edge of the road using 
Kalmaa filter techniques. Corrections are made for perspective as the cluster moves 
towards the cameras 6 and 8, The information obtained from monitoring the movement 
of the cluster is used by the CPU 64 to predict when the cluster will enter the field of 
view 20 of the acquisition camera 8, and in particular when a vehicle reaches a position 
22 which an image of the vehicle is to acquired. The predicted time estimate is updated 
for every field generated by the detection camera 6, 50 times per second. The predicted 
time is continually corrected as the CPU 64 monitors movement of a cluster until it is 
satisfied the cluster will enter the field of view within 10 to 20 ms. A CPU 64 predicts 
the time by specifying the number of scan lines which need to be scanned by the camera 
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« before the dusrers within the field of «• 2" 

Performance of .be contro. unit 10 can be monitored and controlled by peripheral . 
dc vices such as a printer 94 for enor and even, togging, a tea. time status dsptay 9* 

status dispiay 98 is — in Kg.* U which is the Uve image priced by tte 

is IpUyrf a. the .eft of the screen and - bo, around tbe vehic.es axe d«- 
10 hJLlformed. * Ubel number for each duster , shown a. the ,ower 

d*^W-*1— ' The^boxaro. ndfce^s 
represents the processing window, on which the closuring. Mb, and tracing 
soLre operate, in addition to the h*o*am software. The Une across the wmdow . 

m ,!be acquired b, the aa.uUi.ion camera 8. A diagnostic graphics board 82. winch 

^^^^^^^^^^'^ 

time status display 98. 

m image processing P— by the CPU 64 and the APA board 80 for 
vemcie classification is banned by feature ^traction, Bering. .abeiling and tracing 
^ The operation of the software is iarge,, conrroiled by parser 

from a graphical interaaive command tooi tunning under Xwindows on the enntro, 

25 workstation 100. 

The APA board 80 reduces the btnary knage pntels into a stream of feature 
vectors representing the blobs, or regions, in the images. Only a small sub— set of 
fcatures W L can be compu^d by rhe APA are recuu^ being the are, ,,per»cerarf 
30 bounding bo, for each b.ob. or region. A region is represented by raw da. o, 6 b*« 

is la5 the. 02* of the dan ra« for binary images, and is rensonabU for software 
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processing by the CPU 64. 

The raw seed parameters axe read from the APA hardware by the APATask 170, 
as shown in Figure 17. A time stamp is given to each blob, and some initial screening 
5 is performed, where regions such as "black triangles" described hereinafter, are located 
and removed. Time stamping, inter alia, allows any latency in the system to be measured 
and compensated for. The seeds which correspond to white blobs within certain area 
constraints are passed via a VxWorks message pipe to the seedTask 172. The scedTask 
unpacks the raw seed parameters, or structures, and performs classification of regions 
10 based on each regions height to width ratio, "circularity", area and "coverage", as 
described hereinafter. Unwanted regions such as headlight and road reflections arc 
removed and then each classified region is passed via another message pipe to the 
clusterTask 174. 

15 The clustering task is divided into 5ve subsections 176, region classification, 

region extension, clustering, region unextension and cluster classification. Once the 
regions have been clustered into clusters which have been classified as corresponding to 
separate vehicles, the coordinates of the clusters are passed onto a label task 178, once 
again by a message pipe. The label task monitors each cluster over a given period of 

20 time and if a cluster appears in roughly the same place as did a cluster from a previous 
video frame, then the label task considers them to be the same duster. In this case, the 
new cluster inherits the label from the previous cluster. Otherwise if no match can be 
made, the new cluster is given a new label. The cluster's coordinates, along with its 
label, is then passed via another message pipe to a trajectory task 180. The trajectory 

25 task 180 determines the time to trigger the acquisition camera 8 for clusters of a selected 
class, such as large vehicles. The put cluster box task 182, remove cluster box task 184, 
put label task 186, remove label task 188 and the histogram task 190 are tasks used to 
generate graphics overlaid on the video image, as shown in Figure 16, for diagnostic 
purposes. 

30 

The blob shape analysis performed by the APATask 170 and scedTask 172 is not 
extensive during daytime segmentation, as all blobs are considered valid. However, 



: <WO 0Jl044IAlJ_> 



-20- 



1L, - « **. - * » - ith - vehicle blobs ' 

^hicle — , which — »- .he bono. o £ .he d-. - ■ 
TJL U order ,o correct,, .oca,. - — - a, the *« - - 

rod ,ane markers. H~ appear when -he m»r, * - — « 

u -* — *~ - *— * - 600 . the r:m 

10 subtraction is that ^ - market, app~r . have moved. Agatn. toe blob, to -* 

^blemis-blacktriangles'. "ttZ 
L poUrity of blob, .0 be specified incorrectly. If . black reg,on fishes a, ,hc nght 

IT- * - — — * - * t iabeM 

dustering unless mend out by .be seedTask 172. Typ>caUy, when a 

L- L 0* righ. Side of .he pi«L processing window 192, - shown „ Ftgure 18 .. 

nr. J — «. - • -* * ::tr* 

Lesented by white ^ u, .he .op tight band comer. The trtangular blob 19* . 

20 ZL— — *^-~**TTJT£ 

lme line-marker 190. wbrch usually be ideurified and removed by o.her shape 
* l— by .he APA board 80 as blac, and . therefore autotnaucall, 

filtered out. 

25 Regions are classified into one of the following types: 

(i) Headlight reflections; 

Road artefact such as road lane markers, which appear due .. camera 

shake, 

fiirt Lights; and 

30 W Other, during daytime segment mos, of .he regions rha. are no. 

classified as road artefacts are classified -other". 
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During day and dusk conditions, illuminated headlights do not appear segmented 
from other segmented parts of a moving vehicle, and so lights arc not classified. At 
night, however, circular regions are classified as either "headlight" or "small-light", 
depending on the area and position within the field of view 12. Distant headlight pairs 
5 which are typically segmented from the background image as a single joined region, are 
classified as "joined headlights". To obtain correct initial clusters, distant joined 
headlights need to be distinguished from the small perimeter lights of large vehicles. 



The main shape measure that is used during dusk and night time processing is 
10 "circularity". This is a measure which considers how close each blob is to the shape of 
the circle by comparing the blob's area to its perimeter. In the case of a circle: 

Area = nr 2 < 4 > 



Perimeter = 2irr ( 5 ) 

The radius term can be eliminated, since it is only relevant for circles, by squaring 
the perimeter equation and taking the quotient of the two terms. For a circle, this 
produces a constant: 

Area *r 2 1 (6> 



(Perimeter) 2 (2%rf 4n 

15 To make a circularity measurement equal to 1 for a circle, equation 6 is simply 

multiplied by the inverse of the constant. This provides a circularity measure which can 
be applied to blobs whereby a circular blob will have a measurement value of 1, as 
follows: 

Circularity = 4ffArea = 1.0 (7) 
(Perimeter) 2 

For a square blob of unit area, Area = 1, Perimeter = 4, the circularity measures 
20 is as follows: 
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4n - I _ « s 0 .7g5 (8) 
Circularity = . 4 
(4) 

the circularity measures is as follows: 

Circularity = 4* * — ^ 3 g 



-♦v.,i„rlw useful in detecting road 

A **r — ~ * ^ ^ beWt ea the area of 

<= * ■•cov«3B=" Coverage is the measured ratio between ir. 

5 ao.bto.neareaof ..s bouod^ ^ - — 

^r. The APA axes are ^ ^ ^ 

. Tf the Lane markings are not diagonal, but vertical, 

measure is insufficient and in sucn caso 

. rtr icneth can be used instead. 
15 length to it's minor axis lengm 

M ^ - — — «* ~— MOb5 ° f ^ oTe 

20 each cluster is concct. 

headlight reflections by extending the blobs vertically 
25 from a headlight region- 

,ku nf continuous automatic operation. 
AS the vehicle monitoring system is capable of continue 
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clustering 0( regtons .akcs in.0 account diffcren. ligb..ng condiuons TUc .echmquc of 
s,atic background subtract.*, described previously, segments movrng objects from .be 
v,deo image ob.atned by .he defection camera 6, bu. .he regions .ha. result from .he 
segment-on process depend on .he ambient lighting conditions a. the ,me of day 
Duong daytime senior, large regions typically resu.., whereas dunng mgta tunc 
only headlighK and .he smaller slights on true* are segment. During dusk. I.. 
neadUghts do no. appear segn.en.ed from .he orher v«b.e pans of movmg vehK.es. 
however, ref.cc.ions upon the surface of .he road caused by .he headlights need .0 be 
removed, as discussed above. 
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The duMcring process operates on .he scgn.en.cd regions or blobs and each 
vehicle « .ypicaliy segmemcd i».o several separa.e regions, as shown m F.gure 12. For 
insoalcc . a car wi.1 often appear spli. by its windscreen int. a rorf-regron and a 
honne.-reg.ou. Urge vehicles typically segment into more regions. The Custer .ask 
O pour* .hese regrons Wo vehWes" so ,ha. <hcy can be .racked. Dis.an.vch.des 

.end .o be segmemed .ogoher i«o one region d»e » vehicle occlusion at the .mage 
horizon While .he segmented regions a. th* .Usance can be -racked, .he, ca.no. be 
reliably dustered into separa.e vehicles. Emphasis is placed on cmxeCy Cohering lower 
regions ma. are closer tt» the acquisition line 22, and consequently the clustermg process 
20 sons from lower regions .0 higher regrans in each image. 

K „«, venues are segmemed into the same region, .hen they w«l be duaered 
..gemcr. The duster task does no. separate vehicles mat have been segmented together 
,„.o a single region. The co«din«es of each duact are sen, to me label task 178 wn.cn 
matches and separa.es dusters over consecutive video field, The cluster .ask and >he 
label task classify dusters on the basis of dassificarion data. The coordinares passed .0 
.he trajecory task 180 correspond ,o an esumanon as to the front of the vehide. a, fte 
road surface level. Cluae. information on all vehides is provided to the trajectory task, 
which tracks the dusters and sdects for which vehicles images are to be acquued. 

30 ... j 

Optimal dustexing is achieved as a middle point between "over duaenng and 

■•under closing" A. the over dusking extreme, all regions are clus.ercd tnto one 
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^ eluSKr and - 0* - lowest veh.Ce in the duste, »~ ■ *^ 

IL. potnt - each duster is passed by «be label task .0 - 

HatiL of the cluster, which is base* 0- » height and width -U be mconec, Ac 

n. ^ — « - — - — - ; rrr: 

5 ohtains its own unique cluaer and M -hen the rectory «* » over-burdened » - 
5 obtatns. ,^ veMc i ecUs silic a rioov«Ufailin a nu»b H ofmst a nc«.»ud 
attempt to track every region, vehicle cbssukki™ 

taag l *m be fcadvcneolly acquired and hissed. For the purposes of vehicle 

i, U to mistake a vehide-fro* for vehide-mof and so. byaddmg . » 
10 of another c ta ste, no, track the veh.de-f.on, Therefore the duster task has bee^* 



clustering- 



The cluster task performs duaenng essentia,* by etfendmg the boundary of each 
15 segmented region by a certain amount. - - **« <^ <^ 

that overlap are * task, however, de™ co^me 

J u nt of elusion which sbou* be applied . eacb region, 
segmentation, very m. «*- e*ension is reaped, yet during aig* -* 
X— sr^ sparse region, mat "«"" -* — ' ° f 

20 eneusioa in order to achieve overlap. 

M hnporrant .spec in the constriction of a cluster is that .be bottom repon ft 
cluster should be the front of a vehicle. Invalid regions, such as rc gions due to 
ba aUgh. reflections, m-st not be clustered, and are thus not «tendeo. After everyvaW 

25 vehiclctp ..,. „„ lowest is considered first which is the region 

with the lowest region in the image. The lowest is euro 

most likely to cause triggering of the acquisition camera 8. 

m ccdinates of the lowest region are used to initialise a cluster struoure. 
30 Then aU e^endeo- reg^ above the in** region are tcsKd for ovetUp. K an, regton 
no, overiap with the coordinates of th. cl»~r, then rhe ^coordinates ~ 
^ d ,. indude the region and , he region U marked as dustered. Whenever a new 
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region ,s added .0 a M a" ™>™»S unci --red region become possible dus,e, 
candi.ia.es again. Thus the lis. of regions is ...versed again from .he bottom of .he 
image Al.hoagh to regions in d. Hs, which ha.e already been marked as dus.e,cd can 
te skipped, .his is considered sub-optimal. Once rhe entire lis. of reg.ons have been 

5 traversed withou. any ~* — *• "» dust " * "* "* ^ 

remaining region toe clusttring process continues in Uus manner unnl no reg»ns are 
,en undus-ered. The lis. of dusters are then une*ended and passed to the label task. 

m performing region extens.on, region are extended by a variab.. amount in .he 
l0 vertical direaion. but exumded b, . standard amount in the tanizc»U direction -th 
reference ,0 u,e APA coordma* axis. Horizon! extension is unnecessary dunng 
daytime segmentation, as a vehicle blobs .endu.be connect across the fuU w.d<h of 
to vehicle. I. is in .he vertical direction .to. blobs due to the same veh.de appear 
aisconncoed. For example, two blobs that typical* represent a car might be due to «s 
1S bonne, and its roof. Tnese two bioos will stretch over the loll width of .he venide. and 
appear one above ,he orher. Fmthermo*, so long as o« blob for each vehicle wretches 
,he full wdth, the dus« coordmaKS will be wide enough to mcorpora* any blobs tba. 
migh. oti,«rw« need horizon*, extension to be clustered together The fuU widm blob 
pmvides .he exumsion With reference .o rhe cxamp.e illustrated in Figure 20, the region 
20 210 bcomnes added .o the region 212 on the right, from which the duster 214 is begun, 
orfy because me full width region 216 above was added to me region 212 .o form the 
duster 214 U the regmn lis. was no. researched from the beginning of the bs. 
eonrinuous.,, the overlap of to previously u^cd region 210 would not have been foono. 
„ * for this mastm -hat the clustering task, as di*ussed above, reconsiders all undustered 
25 regions after adding a region. 

The duster task is able to perform one of two extension methods. The first 
method takes the vertical or Y coordin».e of .he region as a. inpu, to a look-up .able .to. 
specifies .he amoun. of extension to be applied. The amount of the extension, and hence 
30 thedegreeof dustering, « to mc^ifiedaccordir* flighting conditions. Astheouts.de 
level decree, and regions reduce in six*, the amount of exKosion aopticd .o 
regions can be gradually increased. Furmermore, me perspective in the image can be 
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con peusa,ed fa by » the -lues stored in .he look-up — «— rtr. - 
d Jn, regions high . d. camera .mage can be encoded less than near .e^ons which 
ae 1<W „ the image. A. example of the ex,cusi« values s,or.d in .be look-up .able - 
is by .he graph 218 shown in Figure 21 of elusion amoun, v. Y coordtua.es 

S All exKnsion amounts are provided in pixel numbers. Toe second cx^on method 
^ each region by an amount proportional » i* width. Toe memod is largely base 
onanobservarionof the shapes of regions obtained daring daytime segment™. Small 
regi ons, whichar. typically faraway, are munmally exuded, large vehide body regKms 
which are typically dose, soua.e and occur one pet vehicle, are r-unimaUy extend* and 
10 wide shor. regions, which are often vehide fronts, are greatly ex-ended. Esse^Uy. »s 
iUnstr-cd in F.gurc 22, this results in every regie, boundary 220 and 222 beutg 
approximately so.ua*. to Figure 22, the bounds 220 and 222 of both regions 224 and 
226 bave been extended vertically ,0 equal a. leas, .he* w*h. Therefore the wide shor. 
regi on 224 has been extended a grea. deal reore than d» large square reg.00 226. Ramon 

Therefore, tue two regions 224 and 226 can be matched wStou. too much ex.cns.OB. If 
the large region 226 is over extended, then i. may overlap win, a succeeding vehide 
Son, m ,he preferred embodiment, mis memod is only employed during daytune 
segmentary as nigh, .ixae processing requires a large amount of region c*eus.c* 
20 almougb i. is envisaged the exnmsion facet used in me ex.ens.on calculation can be 
enlarged for night time use. 

Donng ruga, dme dus.eru.g all of .be regions .o be dus<eted ate essennaily small 
cirdes, and a truck duaer, for example, is constructed by considering the possMuy of 
,5 whether each Ugh. could feasibly fl.te.md truck template. For .he firs, repon . 
a ctasKt. » 6. within .he templa*. mere is a maximum distance of light separation which 

cannot be exceeded. 

Overlap of regions is de.ec.ed by comparing the coordinates of regions and 
30 doners, wucrem the .op-let. (x„y,) and boaom-ngh. («,*) -tdtces for bo,h regions 
.ndctasters are known. For the image plane coordinates, x ureases from lef, to ngb, 
Md y increases from .o P ,o bottom. Considering ftrs. the horizon*, x coordmare. 
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. ™« R R R R. R, and R, illustrated in Figure 23 the .est for 
overlap for the regions R„ K* *5. • 

overlap with the cluster C„ is: 

, , (W) 

c.(x.) < R.W <U> 

U both of .he two equations are uue. then there is overlap in the horizontal 
airecoon. Therefore, horizon*, overlap . true fo, R* R, R* and Rj but region R, farls 
^ as equation 10 is not «ue and region Rj tails the test as equation 8 ts no. nuc 
A similar test is performed in the vertical direction as follows: • 

R,(y 2 ) > c.<y,) <U) 

there is no need to perform the complimentary test for R,(yi) because the regions 
are outpufted from the APA board 80 in order from top to bottom and as the Cusu, task 
processes all regions in a lis, from the bonom up, .he complimentary test, CM > 
10 is unnecessary as it will always be true. 

dustenng during day lighting conditions is based on the overlap test discussed 
above yet during dusk and nigh, conditions duaering invoives co*idera«on of 
addition* rule, primarily cue to me increased ambiguity and greater sep.ra.ion between 
15 regtons o. me same vehicle. Certain regions should also never be dustcred, such as 
benign, reflections and noise from backgrcund image areas due to vibration of the 
dctecnoccatneraSdtscussedprcviousiy. C^rmg^forea^mvolvesconsidera.^ 
of a series of rules based or. the various region dasstfications discussed previously. The 
rules include: 

An extended region must spatially overlap a duster 10 be added to that 

If a region overlaps more than one duster, then il is added to the lowest 

A region to be dustered cannot already have been added to the cluster- 
A 'joined headlights" region cannot be added to an existing cluster. 



20 0) 
cluster. 

00 

cluster. 

(iii) 

25 (>v) 



Regions of this type can only initiate a cluster. 
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(v) 0 „ y a predetermine* number of "headlight" regions can be added to a 
J A . he : npa svste m paiamrtcr which can be adjusted from 
cluster, the predetermined number being a system param 

" ""(Tt - W and — ^ - * — - * , 

~ i *nch — - — - - - — « 

• v.«. » duster but cannot be added to a cluster. 

F0I aroadway.cioa.rs . cUsstfed M - of three das** * 

iite <a smaii . Cluster dassificatKm is based on the 

^ abated vehicles, ate classified ^ - cluster during 

height and width of each duster box, and the number of lights w, 

TVi height and width data for each classification is modified via 
nieht conditions. The height ana wimn 

0115 m V".- is - unponan. as the dus,e, height because, 

l" t „ vanous vehic>e ctasses, and is use* ,. se, the stored — « 

7 Heail, The height and widfc histogram is show in the taplay of 
thresholds iutomancally. Tie heignt an foUowtae 
, F.guxe W. For example, a dusKr is dassified as a Uuck .f - of the foUo»u. e 

conditions is true: 

(ft The duster heigh, and .Uft exceed ike truck threshold. 
w . , j t u„ duster exceeds the truck width 

(ii) The lighting condition is night and the cluster exceed 



threshold. 

30 



exceeds the small light truck threshold. 

(iv) Tnc clustci height is with* a predetermined range o, the true* berg* 



TOTAL P. 31 
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threshold and the number of small Light regions in the cluster exceeds the truck small 
light threshold. 

As ambient lighting drops, the size of the truck clusters are reduced, and 
5 consequently the height and width thresholds decrease, depending on the lighting 
conditions, as determined by the histogram task 190. The classification for each cluster 
is stored in a clustered data structure, together with the cluster's coordinates and time 
stamp. The clustered data is then passed to the label task 178. 

10 The label task 178 assigns a label to each unique duster and tracks clusters over 

time by matching an array of previously seen dustere to each subsequent video field of 
clusters. If a duster appears in roughly the same place as a cluster from a previous field, 
then the label task 178 considers them to be the same duster. Where a match can be 
made, the new duster inherits the unique label of the previously seen cluster. If a duster 

15 cannot be matched, then a new label is created for that duster. Clusters may disappear 
for a few fields, and it is an objective of the label task 178 to determine whether a cluster 
is indeed new or whether it has just appeared again after a period of absence. 

The matching of clusters is based on location. Cluster size can be used as an 
20 extra match parameter but the current location heuristic has been found sufficient. It can 
be assumed the clusters will not move very far from their position in the previous field, 
and if a cluster moves so far that its boundary coordinates in the present frame do not 
overlap with its boundary coordinates from the previous frame, then the previous label 
will not be transferred. Qusteis can split and join, both vertically and horizontally, as 
25 they are tracked from field to field. Two labelling methods have been developed, with 
the second being the preferred method which is presently used. 

The first labelling method involves two reciprocal tests which are used to 
determine whether a new duster should inherit an old cluster's label. The first test is to 
30 determine whether the centre of a new cluster 230 lies within the boundary of any 
clusters 232 and 234, as shown in Figure 24, on a list of previously seen dusters, called 
the label list. For the cluster 230, the test fails, but for the new clusters 236 and 238 
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their centres fall within the older cluster 240 so the lowest new cluster 238 inherits the 
label of the old clusier 240, and the upper new cluster 236 is assigned a new label. The 
second test, which is executed when the first test fails, determines whether the centres of 
any of the clusters on the label list lie within the boundaries of the clusters from the 

5 current video field. Therefore as the centres of the old clusters 232 and 234 fall within 
the boundaries of the new cluster 230, a match is detected, and the new cluster 230 
inherits the label of the lower old cluster 234. Applying the second test to the new 
clusters 236 and 238 results in failure as the centre of the old cluster 240 does not lie 
within any of the new clusters 236 and 238, and therefore applying this test to these 

10 clusters would result in the new clusters 236 and 238 both being assigned new labels. 

The second labelling method is based on the clustering overlap technique 
described previously. Essentially, the bounding box of each cluster from the current field 
is tested for an overlap with clusters in the cluster list. The cluster list is search from 

15 bottom to top, in a similar manner to the search method described for detecting 
overlapping regions. In this way, if two clusters merge into a single cluster, then the first 
overlap found will be an overlap with the lower cluster. Once a match is found, the 
search is terminated, and the label which is transferred is marked as applied to a new 
cluster. Therefore a label cannot be transferred twice within one search of a new video 

20 frame. The second method is preferred as it requires half the number of tests as the first 
method, and a cluster can move further between successive frames yet still inherit its 
label. In the first method, where centres arc matched to the boundaries, the maximum 
displacement allowed between fields is half the width (or height) of the dusters, whereas 
in the second method, where boundaries are checked for overlap, the maximum 

25 displacement is the entire width (or height) of the cluster. Therefore the second method 
allows a cluster to move twice the distance of the first method. 

As clusters travel successive fields in time, they tend to split or join, and if a 
cluster splits, then the label is transferred to the lower of the two clusters, and the upper 
30 cluster, which would typically be another vehicle behind the lower cluster, is provided 
with a new label. Alternatively, if two clusters join, then the old lower cluster's label is 
transferred to the new combined cluster, and the other cluster's label is allowed to expire. 
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The label of the lower of two clusters is transferred after a splir or join because the 
lowest cluster is most likely to include the front of a vehicle, and is therefore given 
priority with regard to maintaining cluster labels. 



10 



A record of the bounding box coordinates is maintained for each clusrer in the 
cluster list, together with its label, the labels age, and when the cluster was last seen. 
Whenever a label is inherited, its age increases, and its last scene value is reset. If a 
label is not transferred in the course of one field, its last scene value is incremented. A 
label is removed from the cluster list if its last scene value exceeds a label tenure 
threshold. Cluster labels, coordinates and classifications are passed to the trajectory task 
180. 



The trajectory task 180 uses the received cluster data to track the clusters over 
successive video fields. The coordinates used for tracking a cluster box are the 

15 coordinates of the centre of the base of the box, and the coordinate system for the 
roadway 16 which is adopted is illustrated in Figure 25. The datura 300 of the roadway 
coordinate system is an arbitrary point on the roadway, which has been chosen as the 
centre of the left hand fog line underneath the edge of an overpass bridge holding the 
cameras 6 and 8. Vehicles 302 travel in the positive Y axis direction on the roadway 16, 

20 starting at a negative value in the distance. The trajectory of a cluster box in image plane 
coordinates (x,, yj, as shown in the graph of Figure 26 is not linear with rime due to the 
effect of perspective. Therefore a camera transformation is applied so as to convert 
image plane coordinates to real world 3-D coordinates. In matrix form, the overall 
camera transformation is as follows: 



0 (t 
0 0 



1 0 

0 1 

0 0 

0 0 



0 0 

0 0 

-Iff 1 

0 1 



or' 1 



(13) 



25 where 



a, X-axis scaling factor in pixels/mm (intrinsic) 
a, Y-axis scaling factor in pixels/mm (intrinsic) 
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Xq image plane offset in pixels (intrinsic) 
Y 0 image plane offset in pixels (intrinsic) 
f focal length (intrinsic) 

^cam detection camera 6 position in world coordinates (extrinsic) 

The intrinsic parameters are innate characteristics of the camera and sensor, while 
the extrinsic parameters are characteristics only of the position and orientation of the 
camera. The principle point of the image plane is the intersection of the optical axis and 
that plane, at coordinates (V*o)- Equation 13 can be written as: 



(14) 



10 where C is the camera calibration matrix, a 3 x 4 homogeneous transform which performs 
scaling, translation and perspective correction. The image plane coordinates are then 
expressed in terms of homogeneous coordinates as: 



Y 1 = ^ tt« 

The general perspective transform maps a ray in ihree dimensional space to a 
point on the image plane. For vehicle coordinates in the image plane as seen by the 

15 detection camera 6, a unique three dimensional location of the vehicle cannot be 
determined so the bottom of a cluster box received from the label task is considered to 
be on the roadway, i.e. z = 0, and therefore the box can be tracked with reference to the 
roadway x and y coordinates. The equations 14, 15 and 16, given the image plane 
coordinates and z, can be solved simultaneously for the roadway coordinates x and y to 

20 specify the position of a vehicle. The equations have been solved using the computer 
algebra package MAPLE, and the solution, in C notation, is as follows: 

den = (-X-C31*C22+*-C32-Cn^ 
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v = -(-Xi*arC24+Xi*C34-C2H(Yi a C21-C21)-Cl4 + 

(Xi*C33 w C21-Xi*arC23)'z+(Yi*C3l-C21 B z*Cl3+ 
(-Yi*C34+C24+(-Yi'C33+C23)*z) s Cll ) / den; 

5 x = (-C24*Xi"C32+C22 w Xi-a4+CYi'C32-C22)-C14+ 
(C22'Xi*C33-C23'Xi # C32)'z+ 

(Yi*a2-C22)*z*C13+(-Yi*C34+a4+(-Yi'C33^C23)*z)-Cl2 ) / den; 

The solution explicitly includes height above the roadway, z, which can be set at 
zero for daytime operation or some marginal distance above the roadway, whereas at 
night, the bonora of the cluster box generally corresponds to the height of the headlights 
above the road, and therefore z is set to a notional headlight height. Figure 27 illustrates 
a graph of the same vehicle trajectory as in Figure 26, after the trajectory has been 
mapped to the roadway coordinates x and y. The trajectory illustrates the vehicle is 
moving at a constant speed, and in the left hand lane. 

The time at which the vehicle 302 will reach the acquisition line 22, and the 
future location of the vehicle 302, need to be predicted, due to latency in the system. 
Considerable latency exists between a trigger request and image acquisition via the 
20 acquisition camera 8, and additional latency is caused by pixel transfer, image processing 
pipeline delay and software processing delay. The information obtained on the basis of 
the images required by the detection camera 6 provide a delayed representation of the 
actual vehicle position, and therefore it is necessary estimate the future position and speed' 
of the vehicle 302. 

25 

The position estimates of a vehicle obtained by the inverse perspective discussed 
above are quite noisy due to quantisation effects, particularly when vehicles are in the 
distance, therefore simple differencing cannot be used to estimate velocity of a vehicle 
and therefore the software uses a Kalman filter to reconstruct the vehicle's lateral and 
30 longitudinal position and velocity states, based on the noisy observations of the vehicle 
position. The vehicle state for each of the longitudinal and lateral axes comprises 
position <u and speed <b of the vehicle, represented as follows: 



10 



15 
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X = [a> cb] T (17) 
In space srarc form, assuming constant velocity motion, the vehicle dynamics are 
5 X=*X (18) 

i = CX (W> 

where X is the observable output of the system, being the vehicle's lateral or 
10 longitudinal position, $ is the state-transition matrix, and C is the observation matrix. 
For constant velocity morion the matrices are as follows: 



1 T 
0 1 



C = [10] 



(20) 



(21) 



where T is the sampling interval, being equal to the video field interval which is 
20 ms. The Kalman filter equations for one axis are 

15 K = *PC T (CPC T + ly* (22) 

X = *X + K(y - CX) (23) 

P = *P* T + R,I, - KCP* T (24) 



20 



25 



The filter is predictive, and X is the predictive value of the vehicle state for the 
next sample interval. K is a gain, P is the error co-variance matrix, and I 2 is a 2 x 2 
identity matrix. R t and are input and output co-variance estimates, and are used to 
adjust the dynamics of the filter. 

The Kalman filter equations 22, 23 and 24 are complex and time consuming to 
execute in matrix form, and the computer algebra package MAPLE was used to reduce 
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the equations to scalar form, as follows, in C notation: 



/• compute the filter gain 7 
den = kp->pll + "R2; 
5 kl = (kp->pil + T ' kp->pl2) / den 
k2 = kp->pl2 / den; 

/" update the state vector 7 
xl = kp->xl * T ' kp~>x2 +kl " ('y - kp->xl); 
10 x2 = kp->x2 ♦ k2 • (*y - kp->xl); 

kp->xl = xl; 
kp->x2 = x2; 

15 /" update the covar matrix (symmetric so keep only 3 elements) 7 
pll = *R1 + kp->pll + 20 ' T • kp->pl2 + T • T " kp->p22 - 

kl • kp->pll - kl • kp->pl2 ' T; 
pl2 = kp->pl2 + T ' kp->p22 - kl ■ kp->pl2; 
P 22 = - R1 + kp->p22 - k2 • kp->pl2; 

20 

kp->pll = pll; 
kp->pl2 = pl2; 
kp->p22 = p22; 

25 The estimated values for the state of the vehicle and error covariancc for the filter 

are calculated using the equations and are stored in a data structure "kp. Optimal values 
for R, and R, are determined empirically. Figure 28 illustrates graphs which can be 
plotted from the estimated values for one axis, being the estimated position and estimated 
speed of the vehicle, and the estimated error associated with the camera filter 

30 calculations, as each video field is received. The estimated acquisition time is calculated 
by using the estimated vehicle state data. As the position 22 at which acquisition to 
occur is known, the estimated acquisition time is calculated by taking the difference 
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between the csrimatcd position and ihe acquisition position, and dividing the result by the 
estimated velocity of the vehicle. When the estimated acquisition time falls below a 
value which indicates acquisition is to occur within the time of the next video field then 
the estimated time information is provided to a nigger board 84. The estimated vehicle 
5 state coordinate for the x direction indicates which camera 8 of a multi-lane carriageway 
is to be triggered. 

Tie scaling matrix C of equation 14 may be calibrated using road markers or 
preferably telescopic stakes which are placed at predetermined positions along the 
10 roadway 16- The stakes are surveyed with respect to the roadway datum 300 to obtain 
the x, y and z coordinates for different positions on the stakes, and then removed- 
Equation 14 can be expanded as follows: 

C^x + C^y + C^z ♦ C 14 - GjjX'x - C^X'y - C^X'z - C^X' = 0 (25) 

15 

C„x ♦ (^y + C^z - C» ~ C^TTx - C^Y y - C^Y'z - C^Y = 0 (26) 



which relate an image plane coordinate (X\Y) to a real world coordinate (x,y,z). 
For n observations this can be expressed in matrix form as follows: 



1 r- ^. 




1 


















a 
a 


C33 





(27) 



x ft y 0 z n n o o o o -X' A -x;y 8 -r A 

0 0 0 0 x fl y B z D n -Y' A ~Y' a y n -Y' a z, 

20 The equations are homogeneous and therefore the overall scaling of the C matrix 

is simply chosen so that = 1, and this parameter is not identified. Equation 27 has 
11 unknowns and for a solution requires at least 55 observations, being pairs of (X\Y) 
and (x,y,z). The system of equations is generally over determined, and a least square 
solution is obtained using a singular value decomposition technique. For solution the 
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calibration points x,y,z must not He in a common plane. The real world coordinates arc 
obtained from the survey results, and the image plane coordinates (X\Y') are obtained 
from a display of the detection camera image of the survey stakes using a cursor plotting 
software package. 

5 

To achieve correct triggering of the acquisition camera 8, the timing of the system 
needs to take into account the following: 

(i) The system timing: the system must have sufficient temporal resolution 
to facilitate accurate image capture, i.e. the system must have a sufficient vehicle 

10 acquisition rate, such as two vehicles per second, to avoid omission of vehicles on the 
roadway. 

(ii) Prediction: determining the time of which an image of a vehicle is to be 
acquired, and thus initiate image acquisition* 

(iii) Acquisition data flow: timing to perform the physical interfacing between 
15 the acquisition camera and the acquisition sub-system 68 responsible for each image 

capture and storage. 

The system liming is resolved at two levels, a coarse level considered to start from 
periods greater than 24 hours, and a high resolution, fine level. The coarse level liming 

20 is maintained by a real time master clock 3S4 of the trigger board 84. as shown in Figure 
29. The geometry of the acquisition camera 8 is chosen to limit the effects of 
perspective, limit image blur and take into account other constraints imposed by 
limitations in the depth of field available, and for an overpass bridge mounting, the image 
acquisition point 22 is between 17 and 20 metres from the camera 8, and the camera is 

25 at an angle greater than 15° and approximately 24° to the roadway. A target vehicle 
traverses the acquisition point 22 within the field of view 20 in approximately 40 ms, 
being the acquisition window, at a nominal vehicle speed of 100 kxn/h. The real time 
clock 354 provides tuning down to 20 ms intervals. Due to the uncertainties in the 
position of target vehicle accumulated during the segmentation, clustering and trajectory 

30 tasks, one or more timing events during the acquisition window are not sufficient to allow 
reliable image capture, therefore the high resolution tuning is resolved to horizontal video 
line scan times, being approximately 64 fs. 
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The CPU 64, as described above, is able to classify vehicles during the region 
analysis and clustering procedures and, in particular, is able to distinguish large vehicles 
and small vehicles on the basis of the size of a cluster. If the CPU 64 determines that 
a cluster represents a vehicle for which an image is to be acquired, the final estimated 

5 acquisition time determined by the trajectory task is supplied to the trigger board 84, as 
shown in Figure 27 via the VME bus interface 350. The CPU 64 supplies the estimated 
time as a 31 bit value, which represents the number of the horizontal scan line during the 
next field, which when reached indicates the acquisition camera 8 is to be triggered. The 
VME bus can be used to write the number of the scanning line at which acquisition is 

10 to occur into an acquisition line register 352 of the board 84- For a multi-lane 
carriageway, the CPU 64 also provides data to indicate the correct acquisition camera 8 
to be activated, as determined by the horizontal position data of the vehicle. In addition 
to the acquisition line register 352, and the master clock 354, the trigger board 84 
includes a comparator 356, and a scanning line counter 38 which also includes a count 

15 register to store the value of the line count. The master dock has a battery back-up 360 
and is synchronised to the horizontal sync of the detection camera 6 so as to accurately 
keep track of video fields, reset the line counter 38 at the end of each field and be used 
as a basis on which time stamp information can be generated for allocation to the raw 
seed parameters processed by the APA board 80. After the number of the acquisition line 

20 has been read into the acquisition line register 352, the line counter 358 counts the 
horizontal scan lines on the basis of pulses provided from the digitiser board 74. The line 
count of the counter 358 and the number held in the acquisition line register 352 are 
compared by the comparator and when the two numbers are the same, the comparator 
issues an acquisition pulse on the line 32 for the acquisition camera 8. Providing the 

25 trigger board 84 to trigger the acquisition camera 8 is also more accurate than relying on 
software control as the CPU 64 is open to interrupts and therefore cannot be relied on to 
accurately control the signals of real time events. 

The image acquisition camera 8 has been developed to acquired detailed electronic 
30 stills or images of vehicles travelling head-on towards the camera 8 at speeds up to 160 
kxn/h. The frame rate is at least two pictures per second using a non-interlaced scanning 
mode. Standard camera architectures suffered limitations of insufficient resolution, image 
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smear and unwanted effects caused by blooming of the image sensor when vehicle 
driving lights or sun reflections shone into the camera 8. Blooming is considered an 
unacceptable image anomaly, particularly if it appears in the licence plate region of an 
image which can severely restrict the automatic or even manual reading of the licence 
5 plate characters. Another unacceptable image anomaly is image smear, which tended to 
occur for standard camera architectures in areas of high contrast, which may include the 
licence plate region as most large vehicles have headlights mounted in the vicinity of the 
licence plate. The effect of image smear tended to increase as sensor exposure decreases, 
and for standard camera architectures, image smear was unacceptably detrimental at 
10 exposure times of 1 ms. 

The image acquisition camera 8 is a high resolution, front-illuminated full-frame 
camera architecture having a 1280 x 1024 pixel NMOS monochromatic silicon charge 
coupled device (CCD) sensor. To prevent smearing or blooming across an image, the 

15 camera 8 includes a lateral overflow drain sensor architecture which provides lOOOx 
antiblooming characteristics. The architecture provides a site to drain excess electrons 
for each pixel, and Eastman Kodak Co. has developed one such sensor incorporating this 
architecture. This combined with extended infrared sensitivity to 1.1 micrometres, 
enables near infrared imaging of vehicles and reduces blooming to an acceptable image 

20 without degrading the clarity of the vehicle licence plate in the images. 

The pixels of the camera 8 are 16 micrometres square with a 70% fill factor and 
have a quantum efficiency of 025 e -/photon at the image exposure wavelength of 
800-900 nm. This makes the camera suitable to operation at exposure times of 1 ms, 

25 which is required to freeze the moving vehicles. The sensor has low light imaging 
capability at 1 millisecond exposure time, but in practice the infrared flash 40 is required 
to provide fill-in illumination as during most operating conditions extreme lighting ratios 
were experienced. This occurs, for example, when shadows impinge on the vehicle or 
when imaging is performed at night. Asynchronous shuttering of the CCD sensor is 

30 achieved with a mechanical shutter, a camera shutter made by Robot, Germany, which 
is electronically triggered for 1 millisecond. The shutter also provides a basis for 
synchronisation of the electronic flash 40, as described below. 
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The analogue output from the image sensor is directly convened to digital dara 
by the camera 8, and the digital image data is capable of being outputred in either an 8 
bit grey level fonnar or in a compressed format, using standard JPEG image compression. 

5 The flash 40 has a flash head which includes an air-cooled Xenon short-duration 

(—500 fjs) flash tube mounted behind a minor reflector. The mirror reflector produces 
a narrow beam width for the illumination of one lane 35 The power pack for the flash 
consists of an air-cooled 100 to 1500 Joule variable output power capacitor pack which 
has a cycle time of two flashes per second. The flash 40 has a wavelength range of 695 
10 run to 1500 nxn. An infrared band pass filter is placed on the front of the flash tube 
which transmits electromagnetic wavelengths primarily outside the human visible range, 
thereby preventing "flash dazzle' 1 of oncoming drivers and practically eliminating 
delegability of the flash 40. 

15 The wavelength at which the filter allows transmission is selected so as to balance 

elimination of driver "flash dazzle" and still obtain an acceptable contrast range for 
retro— reflective licence plates. licence plates with both the characters and background 
having retro-reflective properties are relatively difficult to image, and the selected 
balance between the CCD sensor spectral sensitivity, the flash band pass filter and the 

20 lens filter for the camera 8 is illustrated in the graph of Figure 30. An exposure control 
circuit is connected to the Robot shutter and the iris aperture mechanism of the lens of 
the camera 8. The circuit controls the aperture position in accordance with the level of 
ambient light sensed by the circuit. The circuit provides a feedback signal on line 36 to 
control the power and triggering of the infrared flash 40. As the acquisition camera 8 

25 aperture closes with increased ambient illumination, the flash power is increased to 
maintain an optimum balance between ambient light and flash "fill-in" illumination. The 
circuit also includes a delay element to maintain the average flash power during large 
transient fluctuation of light received that can be caused when white trucks pass or 
sunlight is directly reflected from vehicle windscreens onto the camera 8. The circuit is 

30 based on standard exposure control armies, and, in addition to the delay element, 
includes an infrared sensor to measure the ambient light. The flash power is controlled 
by adjusting the capacitance of the power pack for the flash 40. 
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The infrared flash 40 is mounted at an angle of 9-5° with respcci to the optical 
axis of the acquisition camera 8, and at an angle of greater than 15° to the roadway 16, 
The field of view 39 of the flash 40 is similar to the field of view 20 of the acquisition 
camera 8. The geometry of the flash 40 is important so as to reduce any retro-reflective 
5 effect from the exposed vehicle, in particular its licence plate. The retro-reflective 
properties of the paint used on licence plates is such that the maximum reflected light is 
back along the axis of the flash illuminating beam. The angle of illumination and the 
illumination energy is selected to take into account the diverse range of retro-reflective 
and non-retroreflective paint colours and formulations used on licence plates. Examples 
10 of the images which can be obtained by the acquisition camera 8 of the vehicle 
monitoring system are illustrated in Figures 31 and 32. 

The acquisition camera 8 is connected to the detection sub-system 66 and 
acquisition sub-system 68 by an interface board 359, as shown in Figure 33. The 

15 interface board 359 provides power to the camera 8, can issue data interrupts for the 
processor 360 of the camera 8, and is connected to an image buffer 361 and trigger 
interfaces 363 of the camera 8 by optical isolators 365. The interface board 359 provides 
communications to the control unit 10 via differential RS422 communications interfaces 
367 which are connected by communications cables 369. Hie trigger signal is provided 

20 from the trigger board 84 to the trigger interface 363 of the camera 8 by the RS422 
interconnect. Image data produced by the CCD sensor 371 is available in the image 
buffer 361 of the camera 8 approximately 300 ms after the camera 8 receives the trigger 
signal. At that time a data interrupt signal is sent from the control unit 10 to request 
transfer of the image data from the camera 8. The image data is read from the image 

25 buffer 361 as 16 bit words at a rate of 1 Mword/s, where each word represents two 8 bit 
pixel values. A strobe clock edge is also included in each 16 bit word for timing 
purposes. The 16 bit data stream is converted to 8 bit data at standard logic levels by 
the CPU 64, and the asynchronous image data is then processed by a frame grabber 86 
of the acquisition sub-system 68, which is a Datacube Maxscan board. The image data 

30 is then clocked into an acquisition image buffer board 88 where it is held until transferred 
by a bus repeater 89 to the image buffer and communications controller 57 or a licence 
plate recognition system 51, as shown in Figure 6. 
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The images captured by the acquisition camera 8 possess the following 
characteristics: 

(i) A full lane width of 3.5 metres is imaged. 

(ii) The pixel resolutions of each licence plate character, for character sets of 
5 40 x 80 mm, were at least 10 x 20 pixels for W, Z and O, and a minimum of four pixels 

for a character stroke, such as the letters I, L etc. Pixel resolutions of up to 15 x 30 were 
achieved on characters for a full lane geld of view 20. 

(iii) The average grey level of a character stroke is at least 20 grey levels 
higher than the background of the grey level of the licence plate. 

10 (iv) Both the licence plate region and the vehicle body work are imaged 

adequately to enable identification and verification of vehicle type. 

(v) The quality of the licence plate image is relatively constant throughout a 
24 hour period for all vehicle and licence plate types* 

15 The image buffer and communications controllers 57 include a Silicon Graphics 

Personal IRIS 4D/355 machine as a buffer box 381 for handling intermediate storage of 
images on disk 383, a CISCO Internet Protocol (IP) router 385 and a Summit 
Technologies S2000 ISDN bandwidth manager 387, as shown in Figure 34. The 
remaining description relates to image transfer between the repeater 89 and the buffer box 

20 381, but the description also applies to image transfer between the repeater 89 and a 
licence plate recognition system 51 located at the node 2, as shown in Figure 6. 

The data transfer by the bus repeater 89 to the buffer box 381 is made by a 3 
MB/s digital line. The repeater 89, which is a BIT3 Model 413 VME-bus repeater, with 

25 DMA capability, enables the buffer box 381 to copy data directly from the buffer 88 in 
the acquisition sub-system 68. To coordinate image transfer between the buffer box 381 
and the system 68, an image header structure is established for storage of the images in 
the buffer 88, and messages are allowed to be passed back and forth between the buffer 
box 381 and the system 68 via interrupts in a mail box location. The memory layout for 

30 the image buffer 88 is shown in Figure 35 and the higher memory locations are used to 
store acquired images in buffer segments 370 with a header 372 for each image buffer 
being stored in the lower memory locations. The image header 372 includes date of 
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image acquisition, a base address for the image in the buffer 88, a busy flag to indicate 
whether the image is presently being read, and information on the size of ihe image. A 
memory header 374 at the lowest location in the buffer is shared with the buffer box 381, 
and includes the following fields: 

5 

1. ha-hostintr; used by the buffer box 381 to specify which type of interrupts they 
are sending. 

2. ha-imagenum: used to tell the buffer box 381 which image to read after an 
10 image available interrupt is sent. 

3. ha-numbufs; the number of image buffers allocated in the buffer 88. 

4. ha~height, ha-width: the organisation of the image within the buffer 88. 

15 

5. ha-bufsizc: the size of the buffer, which is a multiple of 256 bytes. 

The architecture of the software modules used by the buffer box and the 
acquisition image processing system 42 is illustrated in Figure 36. The buffer box runs 

20 a capture module 401 which is responsible for communication between the acquisition 
sub-system 68 via the BIT3 interface board 489. The module poles the acquisition 
sub-system 68 for images, stores them in a memory buffer, and then stores them in a 
directory CaptureQ as a file with a unique name. The name is made up of the first five 
character of the name of the buffer box 381 and a ten digit number* A CRC error 

25 checking value is generated and image data is stored in a header of the file, including the 
name of the remote site or node 2, the time the image was captured by the camera 8, the 
image header length, the CRC value and the image width and height. The CaptureQ is 
able to store 500 images, the data of which each occupy approximately 1.5 Mbytes. If 
the CaptureQ overflows, the images are discarded, and the file names of the lost image 

30 is recorded in an error file together with the time the images are discarded. Overflow of 
the CaptureQ may occur if the acquisition sub-system 68 acquires images at a high rate 
for a long period of time, or the link through the ISDN 45 to the central server 47 is out 



(0. *WO MiB**1Ai J_> 



-44 - 

of service for an extended period of tunc. The communications link to (be central server 
47 from each remote site 2 is provided by the router 385 connected to ihe buffer box 381, 
and a X21 protocol link 389 between the router 385 and the bandwidth manager 387, 
which provides a Macrolink"" 391 to the ISDN 45. The central server 47 in turn is also 
5 connected to the ISDN 45 for each remote site 2 by a CISCO IP router 385, a Summit 
Technologies S2000 bandwidth manager 387, an X21 link 389 berween the manager 387 
and the router 385, and a Macrolink 391 to the ISDN 45- Tbe bandwidth manager 387 
and the router 385 form the communications controller 42 of the acquisition image 
processing system 42. The X21 links 389 arc standard B-ISDN communications link 
10 governed by CCITT standards. The Macrolinks 391 are Primary Rate Access links 
provided by the second applicant and are based on the CCITT standards for Primary Rate 
Access in the B-ISDN. The X21 links operate at 768 KB/s and the Macrolinks provide 
two virtual links operating at 384 KB/s. The bandwidth manager 381 is essentially a 
multiplexer which uses a data aggregation protocol and provides access to the ISDN 45. 

15 

The remote sites 2 are each represented at the central server 47, which is a Silicon 
Graphics Crimson machine, by a retrieve module 403 r as shown in Figure 36, which 
makes a socket connection to the respective remote site 2 and polls for an image from 
the remote site 2. The FTP protocol, which is a Unix file transfer protocol, is used to 

20 retrieve images, including their associated data, from the remote site 2 and when received 
the image is checked for integrity of the image data on the basis of the CRC value, and 
stored on a RctrievalQ directory 405 of the server 47 which has a capacity of 720 images. 
The images are stored on the RcrrievalQ 405 with the time when the image was firsr 
requested and the time when the image was finally received. An SDistributor module 

25 407 is responsible for distributing the image file names to store modules 409 of the 
central server 47. The store modules 409 retrieve images from the RetrievalQ 405 and 
archive them in respective image stores 411 which have the capacity to store images 
acquired over a week from each site 2. The image stores 411 arc Exabyte 101 tape 
storage systems which can each hold up to ten tapes that each have a capacity set at 3000 

30 images. The store module 409 communicates with a tape driver for each store 411 which 
based on a tape driver developed by Gene Dronek of Vulcan Laboratories, U.S. The 
driver controls loading and unloading of a tape from a store 411 by a robot arm* The 
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driver on initialisation determines the number of tapes in the store 411, and for a cold 
start formats each tape and loads the first tape. For a warm start the driver simply selects 
the tape last used. When a tape reaches its 3000 image capacity it is returned to its 
storage bay and the next tape is selected. 

5 

The SDistributor module 407 has a list of the names of the files in the RetrievalQ 
405 called Store list and another list of the names of files which are in the process of 
being stored on an image store 411 called InProgrcss list. When a store module 409 
requests a file name, the SDistributor module 407 returns a file name from the store list 

10 and moves that name to the InProgress list. If a file name is not available, the module 
407 accesses names from the RetrievalQ, adds them to the store list and then returns file 
names. When the module 407 receives a storage acknowledgment from the store module 
409, then the file name is removed from the InProgrcss list. The store module 409 poles 
the SDistributor module 407 for a file name, and on receiving the file name retrieves the 

15 corresponding file from the RetrievalQ and copies it onto the image store. The same file 
is also copied onto a directory of the server 47, IPQ 413 which can hold 750 images. 
If IPQ 413 is full, the file is discarded and the header of the file is copied onto a further 
directory DatabaseQ. An acknowledgment message is then sent to the SDistributor 
module 407. A time stamp is placed on all files indicating when the file is archived 

20 

An IPDistributor module 417 distributes images to a licence plare recognition 
system 51 connected to the Ethernet LAN 419 of the central server 47. The module 417 
maintains a list of file names, called Image list, which represents the files held in IPQ 
413. When the licence plate recognition system 51 poles for a file name, the module 417 

25 returns a file name from image list and moves that file name to another list, DPProgress 
list. When the system 51 acknowledges that it has received the corresponding file, then 
the file name is deleted from the IPProgress list, together with the file from IPQ 413. 
If file names are not available in Image list, the names are obtained from the IPQ by the 
module 417, and added to the list. The module 417 communicates with the system 51 

30 via a socket connection. Licence plate details extracted by the recognition system 51 are 
stored on a DatabaseQ 415 of the server 47 together with other image data details, such 
as image acquisition time, and instantaneous speed of vehicle which have already been 
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provided with the image from the remote sites 2. A database module 419 poles for files 
placed on DatabaseQ 415, and then stores the files on an image database 421. 

The licence plate recognition system 51 has been implemented using a Silicon 

5 Graphics workstation 400 which is connected to the LAN 419, as shown in Figure 37, 
but can also be connected directly to the repeater board 89 at a remote site 2. A Pixar 0 
image computer 402 is connected to the workstation 400 and acts as an image 
co-processor. The system 51 also includes a monitor 404, keyboard 406, disc storage 
of 600 MB 408 and optical disc storage of 1.2 GB 410 connected to the workstation 400. 

10 The workstation 400 uses, inter alia, VTVID (Vehicle [dcniificarion by Video Image 
Detection) software owned by the State of Victoria which is able to locate a numbcrplate 
in a vehicle image, and then perform optical character recognition (OCR) on the located 
numberplate to extract the licence plate characters. The parameter settings of the VTVID 
software have been adjusted to handle the images provided by the acquisition sub-system 

15 68, according to the size and contrast of the images. To accept the images at a peak rate 
of 2 per second, a real time image handling procedure 412, as shown in Figure 38 is 
used. The procedure begins at step 414 by requesting an image file name from the IP 
distributor model 417. If a name is not received at step 416, the IP distributor module 
417 is polled again, otherwise the received name is used to access the IPQ 414 and store 

20 the image file on the disk 408, ar step 418. 

usages arc accessed from the disk 408 and processed by four separate software 
modules of the workstation 400, a locate plate module 420, a glyph extraction module 
422, and OCR module 424 and a plate recognition module 426, as shown in Figure 39. 

25 The locate plate module 420, as shown in Figure 40, begins at step 430 by preparing the 
1280 x 1024 pixel image for processing as a number of pixel windows for the Pixar 
co-processor 402. At step 432, the system 51 attempts to detect an edge of a character 
size object, and when detected the object's location is determined at step 434. An object 
assembler is used at step 436 to group adjacent objects together, and the groups are 

30 processed by a plate classifier 438 to determine whether the object groups could 
constitute a licence plate. If an object group is classed as a plate according to a plate 
template, a bounding box is formed, and its coordinates returned to the glyph extraction 
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module 422. The glyph extraction module 422 processes each bounding box to binarise 
and extract individual characters in a bounding box and then pass the "glyphs ", i.e. 
licence plate letters and numbers, to the OCR module 424. The OCR module 424, as 
shown in Figure 41 begins at step 428 by building a typological graphical representation 
of a glyph from the glyph bitmap provided by the glyph extraction module 422 for each 
glyph. The graphical representation is analysed at step 440 so as to detect any 
characteristic features, such as holes, arcs and vertical and horizontal lines. From the 
results of step 440 an 81 bit string representing the characteristic features of the glyph 
is created at step 442. A bayesian statistical analysis is then performed at step 444 on 
the feature string to try and match the features against a set of previously determined 
features characteristic of known ASCII characters. The ASCII value of the match with 
the highest probably of being correct is returned to the plate recognition module 426. 

The plate recognition module 426 determines whether the glyphs in a bounding 
box constitute a valid licence plate. The module 426 effectively controls the other image 
processing modules as it has the ability to override the results of the OCR module 424 
or to force the glyph extraction module 422 to use a bounding box other than that found 
by the locate module 420. The majority of vehicle licence plates in Australia have six 
characters and fall into one of two classes, Federal plates or non-Federal plates. Federal 
plates comprise two alphabetic characters, two digits and two alphabetic characters, 
whereas non-Federal plates comprise three alphabetic characters and arc followed by 
three digits. The plate recognition module 426 is able to determine whether a valid 
licence plate has been found on the basis of this irjfonnarion, and other information, such 
as the spacing of characters and the specific characteristic alphanumeric sequences used 
by the non-Federal plates. The OCR module, for example, may not be able to 
distinguish between capital B and 8, and for many plate fonts, there is no difference 
between a 0 and O or a 1 and an I. Therefore the plate recognition module 426 may 
need to override the results obtained by the OCR module 424. The plate recognition 
module 426 is also able to instruct the glyph extraction module 424 to process an altered 
bounding box if the module 426 determines that there may be additional glyphs to the 
left or right of an original bounding box returned by the locate module 420. The licence 
plate details obtained by the plate recognition module 426 arc stored on DatabaseQ 415 
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of the server 47, and archived on the optical disk 410. The optical disk 410 also archives 
image files which the system 51 is unable to process when received. 

The database on the opricai disc 410 stores for each processed image as does 
5 DatabaseQ 415, data concerning the position, size and characters of the numberplate 
located in the image, and other derails such as time and date of acquisition. It is also 
structured with data pointers which facilitate access to the stored data by the workstation 
400. The workstation 400 includes graphical user interface software which enables an 
operator to review the results of the procedures 412 and 414, and perform further optical 
10 character recognition on numberplate regions, as selected. Any further OCR processing 
performed on a plate region selected by the operator of the workstation 400 is normally 
used to analyse the performance of the procedures 412 and 414 and not to alter the 
integrity of the data held in the optical disc 410. 

The image data stored on database 421 is processed by matching software which 
looks for matches amongst the licence plate details fields of the image data so as to 
locate occurrences of detection of the same licence plare ar different remote sites or nodes 
2. Once a match has been located, the acquisition time fields can be used to determine 
wherher speed or time violations have occurred in travel between remote sites 2, as 
distance between the sites 2 is known. The matching software is run on a Sun 
Microsystems workstation 450 connected to the LAN 419, or alternatively, the matching 
software is run on a system of a road traffic authority, with the image data being sent by 
the central server 47 over the ISDN 45 to the road traffic authority. The road traffic 
authority is able to communicate with the central server 47 via the ISDN 45 to obtain 
archived images, as required. 

To avoid sending all images to the central server 47, a large number of which may 
not be of interest, images can be archived at the nodes 2, and licence plate details 
extracted at the remote nodes 2 by respective licence plate recognition systems 51 
30 connected directly to the BIT3 repeater cards 89 of a node's acquisition sub-system 68. 
The server 47 then only receives the extracted licence plate details, and other data on the 
image, such as acquisition time, the remote site, and instantaneous speed, and not the 
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imagc itself. Images archived at the remote sites 2 can be retrieved by the central server 
47 when required. 



Control of the remote nodes 2 is performed by the remote site user interface 53 
5 which runs on the Sun workstation 450 connected to the LAN 419 of the central server 
47. The interface 53 includes a user tool which communicates with a super task of each 
remote site 2 using a Sun Microsystems Remote Procedure Call (RPC) communications 
protocol. The super task provides a set of procedural functions which can be called by 
the user tool using the RPC protocol, regardless of the location of the workstation 450. 
10 The RPC protocol handles data type conversions and alignment. The procedures provided 
by the super task perform various actions which together allow complete control of the 
software of a node 2. For example, a parameter file maintains a list of all variables used 
by the software of the nodes 2, together with their initial values. The form of the values 
indicates the variable type, which may be a decimal integer, a hexadecimal integer, a 
15 floating point value, a character string or boolean value. The variables can be altered by 
adjusting the parameter file, and location of the variables listed in the parameter file is 
done via a VxWorks systems table which contains all global symbols. The user tool, in 
addition to changing system parameters, can access the super task to obtain status and 
configuration information on each node 2. 



20 



The super task accepts RPC transactions via both the Transmission Control 
Protocol (TCP) and the User Datagram Protocol (UDP), both of which use the Internet 
protocol (IP) for transmission of datagrams between computer systems. UDP is 
connectionless protocol which primarily involves multiplexing of datagrams, whereas TCP 

25 is a connection orientated protocol which seeks to ensure data integrity is maintained. 
The user tool presently uses TCP/IP which, together with the RPC protocol, is provided 
with Sun Microsystem's SunOs operation system and the VxWorks real time operating 
system. To protect against different central stations accessing a remote node and making 
conflicting changes to system parameters, the user tool provides information on the 

30 current state of the node software before any alteration can be made. 

The master clocks 354 of the remote sites 2 arc synchronised to the clock of the 
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A7 d the systems 51 and 450 connected to the LAN 491 using a nenvork 
central server 47, and the systems synchronise the 

. ^ whicb is a standard UNDC utuiiy normally used syn 
time protocol (HTP), «*ucn i ^ mol(: sites 2 and on the basis of 

, ■ , taw The NTP polls the remote sites - 

clocks of stations on a U^- ffl : ra ,i onS between the sites and 

a from the sites 2 concerning communications between 
information received from the sues synchronise the sites 

r . »tt-P applies offsets to the remote sites 2 so as to syncnr 
thc server 47, the NTP appu such 
2 and account for network propagation delays, inciua g 



as link congestion. 
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OAIMS: 

■ means for monitoring movement 

An obje* moononng s,s«eo, '"?~L of said obje* * • * 
of m object „ d-n*. - acquUiuo. «. — - 

at said predetermined tunc. 
5 acquired and acquiring said image at saw p 

, m „ daimed in claim 1, wherein said acquisition time 

image capture position. 

M» as claimed in claim 2, wherein aid camera means 
is adapted to detect said object ana aisaiw— 
moving objects. 

representative of moving objects in said area. 

w „ omtormEsystemasdaimedindaim^ wherein said image processing 
5. An object monitoring sysicm difference 
^ incudes Ossificans* me»s * Arming duaers from par.so.sa> 
^ which correspond to «he same moving ob.ee. 

■ ■ «<«d>iraS wherein said image processing 
, -o^monirorings^^^^ ^ 

aeans processes each cluster <o detemnne .f it corresp 
said acquisition time. 

, • ,a in daim 6 wherein said image processing 
7 . Anoh^n.oni.ormssys.emasc.aunedu.d^ ^ ^ 

30 ffleM ffl.« said diff^ce images » d^regard p«!s w,,hm pre 
range. 
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„. Urn produce at leas, a « ■** CamCra ^ 

, An object M ^— - * * ClMS ~ 

^ JU - — S — valid .0 ttvand — .o ^ 

disregarded. 

. e «v««n as claimed m claim 9, wheTein said classification 
10 An object monitoring system as claimca m . 

^ includes dustcring — » gencradng ^ *— ■ «* — 

^ »*« which arc consider . c^esp-d .o an object, said «»« 

doenn,ne * teg-ons overtap ^ and b~ - - — ^ -~ » 

15 form a duster, 

mM ns inctades labelling »eans for ass,gning ■ » *~ «" ~" "~ £ 
identify respective clusters and for «,a.cb,ug - *— «~ 

imllges » detenus if labels are » •* ^ritcd or new labels 

u An object .nonKonng syae* as daitned in dan* U. wherein said dassif.ca.ion 
^ is ^ to cbssify said cursors as corroding to p,ede«crmined 

^paringcharacKriateof said * * * 

25 said classification means is adapted .0 identify a duaer responding » said ob,ec, 

• • »c claimed in claim 12, including means for 

13 An object monitoring system as claimca in 

^tannug a histogram of said envies for objec* * - — 

means, and adjusting s~l classification data on the b»sis of said to.ogram. 

30 M AO object monitoring system as daimed in daijn 13, including light intensify 
^ fcr deKrminmg a bguung .eve. of said and wherein said ptedc^noined level 
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^ said analyss °« -* «* „„ Mid llgi>lijlg 

cluaering means, and said dassitauon da» are ad )U s<e 
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• • „<t«n as claimed in claim 14, wherein said unagc 

processmg means °> .. ^f^aUon^caBS for donning cooidina.es 

wt ^nsecunve images, compnsmg — ^' -(- ,« and means 
of said ^ ,o -P- - • ^ ^g image, 

fcr predfering the speed and poaoon of sad dusua for eac 

as claimed indaim 14, wherein aid Hacking means 

determines said acquisition time on me on 
predicted speed and position of said cluster. 

• as clcumcd in cLaim 16, wherein said camera means 

17 . An object momtonng system as damiedm ^ ^ 

-..« mfM to acquire said image 01 M1U u j 
includes image capture camera means to acq 

acquisition time. 

20 ^eran^.^.ed^^a^-iuUo.^eofsa.do^. 

limited field of view. 

25 20 An object monit^^ 

!L is synced - said .age capmre camera means, the energy level of 

flash bemg dependent on said lighting level- 

» claimed in claim 20, wherein said image capture 
™ -71 An obiea monitonng system as claunca m « 

IL*. - said image sensor — * response . s*id Ugr-g W-L 
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„ . bj ect monitoring sys.cn, as claimed ,n ciatm 21. satd fash tndudes 

means for UN* *e emission of vUible light therefrom 

23 *n obi ect monttormg *~ ^ — - - — * Wherem ^ 
5 appHed by said chtster — * »— — - ^ Mro * 0ndS " ' 

condition. 

i ^ ™ ,-iaim 23 wherein said extension is 
04 An object monitoring system as claimed in claim 23, wncr 

less for regions corresponding to objects distant from said camera means. 

of said dusters for consecutive images. 

images arc filtered and used to update said background image. 

27 ^ object monitorm* system « <W-d h <*. 26. Wading means for 

m at ca i( i acquisition time, comprising means 
triBeerine said image capture camera means at saw acquis 

20 rjL.-^— --■--'Ti- 

^ sa.d tracfcng means, mean, for « - Unes of said .mages, and 
general a tngge, stgna! for sarf nna 6 e ca^re camera means wnen sa.d coon, reaches 

said number. 

28 ^^w^^»^^ V ^^ m 'T^ 

_ J— . and d—s • day. nigh- or twiugh. nght oo the basrs of tbe 

median of said histogram. 

levcl ^ is d«enni«d on the basts of ** -W— • — - ^ * 
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« in claim 29, wherein said measurements 

30. An object monitoring system as claimed m claim j*. 

comprise circularity and coverage of said regions. 

3l An object monitonng system as claimed in any one of claims 1 to 30 including 

• ,h, ttBuiftd image to obtain information identifying 
5 recognition means for processing the acquired image 

said object. 

M another so as t. naffer information on satd object. 

k; ^itoriitt system as "aimed in claim 31 or 32, including a plurality 
33. An object „»n.tonng system ,„ communis with 

of said camera means facta** respective ar~s, and adapted to comm 

a cenWl «D> - - » infonMti0n ° D "* °* tt 

a b„atleast two of said camera means and said mformahon can be 
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areas. 

35 

in< 
station. 



35 ^ object momtonng ^ as claimed in claim 34, wherem said cental station 
^ terno* control means for conning said camera means from sard centra, 



communicatc using a digital telecommunications raw*. 

37 An object monitoring sy*«n as Calmed m Cairn 36. inCuding means for 
38 . An object monitonng system as ciaimed in Cairn 37. wherein said information 
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■ M ^ -~*> - - - * ™ K ot ac " uis " ion ' an " M ' d ccn " a ' 

station includes said recognition means. 

39 An objec. coring sys.cn. as daimed in Cain, 37. wherein said —n 
incl „des said identifying information and ,he .in.es of action of acouircd » 
L ooicc, and a M of said recognition — - — - - — » °< 
camera means, respective,,, - *■ - - -* « " — ""^ 

4 „ An o^ee, moni,.ring sys.cn. as daimcd * — » « »■ — 
10 ^..on means * adapKd .0 process said a.u.rcd image » U- P- 
rcpresenwiv. of rtaraoeristic pixels identifying said object. 

«. An objec. numuoring sysum, as daimed .a any one of daims , <o 40. wherein 
said object is a vehicle. 
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* in claim 41, wherein said recognition 

42 An object monitoring system as claimed m claim 

mcanS composes means for locating a licence plate in said ima g e and means fcr 
determining the cheers of said licence plate, said cheers cmpnsin, sa,d 
identifying information. 

43 An objee montonng sys.cn. as daimed in Cain. 42. wherein said c«de,crmi»ed 
,„valid level range covers pod levels produced by shadows of said vehicle. 

44 An object moni-oring sys.cn, as claimed in darn, 43. wherein said invalid regions 
25 corresponds - headligh. reflections produced b, said vehicles or road lane n.ar k .ngs 

within said area. 

45 . An objec, moni,oring sys.em as claimed in any one o, Cairns 4! .0 44. wherein 
said vehide is a large vehicle, such as a bus or truck. 

30 

4« An objeamoniroringsyaem comprising camera mean, for moniroring mov,ng 
objeos. and image processing means, responsive .o said camera means, for derecmg a 
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prion** moving objec, from other moving and stanc objects. 

47 An ob,e« mentoring system as Canned » data 46. wherein said image 

^ JTg mL , adamed ,0 rra* « -* «*» - *™ 

5 ^ nro acquire an image c£ said pcdcKrmtocd moving ob,ca. 

48 objec, n^-oring as daimcd ,» claim 47. including Ugh. intensny 

Lns ildcs exposure con** means * « — " ' 

TT1( ., T1 «: adiusts parameters for delecting said 
10 said lighting level and said image process** means adjuss par 

p^eKrmined movrng object on the basis « said lighting level. 

49 ^ object monnoring as claimed in daim <* wherein said 
Ldesad^neamerafcr — said moving ohjec. and an ac,u,s.uoa camera 

15 mggered by said image processing means for obraining said unage. 

x claimed in claim 49. including means for 

50 An object monitoring system as claimeo in 

pttcessing said image . extract information identifymg said object. 

20 5l An objec monitoring system as claimed in cUim 50. including means for 
ransmitring said image over a digital telecommunications network. 

S2 . » object monitoring system as ciaimed m claim 51. wherein said moving objeos 

arc vehicles. 

moving object is a large vehicle 

30 an rmage of a moving objec, from wb.cn mformation identifying sa,d ob,ea can be 
automatically extracted. 



- 59 - 

S5 An ob) ec. — ng sys.em - * '" ClU1 "" e meMS 

said .mage ov« . K lecornmun.ca,,ons netwo.1, 

«. An object — ng sys.cn, as daitned .n daim 55. .ndudmg .cans for 
5 practising said image to e«.act said information. 

. .,„ rine „„„„ « daimcd rn claim 56, including a plurality of said 

. ,<>«„* respective areas, and means for comparing sa.dmfonnat.on 
camera means for monitoring respective ar , 

obtained al said respective areas. 



10 



20 



58 . An objec. monnoring sys.cn as cUUncd in daim 57. said object is a vchidc. 

and r^ng moving vcK,, K eve. a m«,.Mane cama^a, and ™ ~* 
15 prede.crn.tacd ^ a. an acou-sUion area on said carriage from — S« 
informalioo on said vchides can bt exr.ac.ed. 

60 . A vch.de monLoring system as dahncd » dan* 59. Wading a pHnalny of said 
acquirition area, one to each lane of sa.d carriageway. 

61 A veh.ee *— » w * — means *" r 1 !! 

a., firing images of predefined movmg vehides fo. a respect ,ea, and r»e»S 
f0I plying .he image - chained from said ^ . *-* - ~h.dcs and 

n f vehicles between said areas, 
obtain information on the travel of said veniacs 

« A vchide mo»i,orin 8 sys.em comprising can.... means fo. n,oni.oHng moving 
vdudes .0 determine if said vehicle is of a p..de,ern,ined .,pe in response ,herc.o. 
coring respective images of vehicles of said predetermined ,ype. 

to processing said images .o oKain information identifying sa.d vdncle. 



25 



- 60 - 

. • .a ;« rlaim 62 wherein said predetermined 
64. a vehicle monitoring system as claimed in claim 62, 

type includes a predetermined size. 

response to detecting said infringement. 
10 for p™g *id i-ages .0 ob, m fcfe-*. - 
type includes a predetermined size. 

torn which whicle information can be obtained. 

a large vehicle, from said images. 

c«,m as claimed in claim 69, including means for 
70 A vehicle monitoring system as claims 

B — - l,, * ,r " 

determine the average speed of a vehicle. 
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